Skip to content

Pull requests: microsoft/DeepSpeed

New pull request New
130 Open 2,813 Closed
130 Open 2,813 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Improve consistency of zero_grad
#6554 opened Sep 18, 2024 by tohtana • Draft
Enabled configurable auto Tensor Parallelism (TP) for the inference of diverse models
#6553 opened Sep 18, 2024 by gyou2021 Loading…
4
Enabled Qwen2-MoE Tensor Parallelism (TP) inference
#6551 opened Sep 18, 2024 by gyou2021 Loading…
2
Fix gradient accumulation for Z2+offload
#6550 opened Sep 18, 2024 by tohtana Loading…
Use msgpack for p2p comm
#6547 opened Sep 17, 2024 by tohtana Loading…
Fix expert grad scaling problem with ZeRO optimizer
#6546 opened Sep 17, 2024 by wyooyw Loading…
7
reduce setting global variables to reduce torch compile graph breaks
#6541 opened Sep 15, 2024 by NirSonnenschein Loading…
[XPU] Support DeepNVMe new code structure
#6532 opened Sep 13, 2024 by Liangliang-Ma Loading…
2
Set shuffle=True by default in data_sampler
#6531 opened Sep 13, 2024 by ranzhejiang Loading…
1
Fix device selection using CUDA_VISIBLE_DEVICES
#6530 opened Sep 12, 2024 by tohtana Loading…
@tohtana
add bfloat16 to inference support dtypes
#6528 opened Sep 12, 2024 by nelyahu Loading…
3
Fix dynamo issue
#6527 opened Sep 12, 2024 by oraluben Loading…
4
Handle when backend is also in compile_kwargs
#6502 opened Sep 7, 2024 by oraluben Loading…
5
add option to disable logger while compiling to avoid graph breaks
#6496 opened Sep 5, 2024 by ShellyNR Loading…
@tohtana
3
Change compile for pipeline module torch.compile
#6478 opened Sep 2, 2024 by NirSonnenschein Loading…
1
[Accelerator] Cambricon MLU support
#6472 opened Sep 2, 2024 by Andy666G Loading…
5
Adding the new feature of FPDT
#6462 opened Aug 29, 2024 by YJHMITWEB Loading…
10
sequence parallel for uneven heads
#6392 opened Aug 21, 2024 by inkcherry Loading…
8
Unpin tests that previously used a pinned version of transformers
#6387 opened Aug 20, 2024 by loadams Loading…
1
Add weights_only=True in torch.load
#6094 opened Aug 17, 2024 by terry-for-github Loading…
7
Add APIs to offload states of model, optimizer, and engine
#6011 opened Aug 16, 2024 by tohtana Loading…
@tjruwase
26
[NaN check] Add NaN check to support bfloat16.
#5879 opened Aug 8, 2024 by ys950902 Loading…
2
Fix circular import in ds_transformer.py
#5804 opened Jul 28, 2024 by sznmelvin Loading…
3
Add DataStates-LLM: Asynchronous Checkpointing Engine Support
#5763 opened Jul 10, 2024 by mauryaavinash95 • Draft
2
Switch what versions of python are supported
#5676 opened Jun 17, 2024 by loadams • Draft
1
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.