Skip to content

Pull requests: NVIDIA/Megatron-LM

New pull request New
373 Open 2,467 Closed
373 Open 2,467 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[PP] Add initial overlap_p2p_comm support for non-interleaved steady-state 1F1B community-request
#4456 opened Apr 24, 2026 by cky-dev Loading…
1
2
Fix cache gating
#4455 opened Apr 23, 2026 by wdykas Contributor • Draft
5 tasks
Core 0.16
6
Inference: Fix broken functional tests on gitlab complexity: high module: rl
#4454 opened Apr 23, 2026 by sidsingh-nvidia Contributor Loading…
5 tasks
Core 0.16
@sidsingh-nvidia
2
Port Multi-Latent Attention to HybridModel complexity: low
#4452 opened Apr 23, 2026 by janEbert Contributor Loading… Core 0.16
8
dist_ckpt: add --stream-ckpt-dequant to fix OOM on large FP8/MXFP8 loads with --fp8-param-gather complexity: medium Run functional tests
#4451 opened Apr 23, 2026 by asolergi-nv Contributor Loading…
4 of 5 tasks
Core 0.16
3
Fixes for modelopt examples and SFTTokenizer for transformers v5
#4450 opened Apr 23, 2026 by jenchen13 Contributor • Draft
5 tasks
Core 0.16
2
Add troubleshooting tip for 'access forbidden'
#4449 opened Apr 23, 2026 by balasaajay Loading…
2 of 5 tasks
Core 0.16
5
Fix checkpoint loading with rerun state machine Approved All necessary approvals have been made complexity: low
#4448 opened Apr 23, 2026 by YangFei1990 Loading…
3 of 5 tasks
Core 0.16
1
11
Add PackedSeqParams construction helpers. community-request
#4447 opened Apr 23, 2026 by bbuschkaemper • Draft
5 tasks done
1
Add functional tests for NVFP4 native param gather community-request
#4446 opened Apr 23, 2026 by re-imagined Loading…
2 of 5 tasks
3
fix(ci): re-enable scoped_cudagraph MoE test with TE 2.14 golden values complexity: medium
#4444 opened Apr 23, 2026 by buptzyb Contributor Loading… Core 0.16
2
Handle SSM sharded tensor merge OOM with CPU fallback community-request
#4442 opened Apr 23, 2026 by returnL Contributor Loading…
2 of 5 tasks
1
2
Inference: Add the embedding and output layer in the full_iteration_inference cuda graph scope for hybrid models complexity: low Final Review PR is in the "final review" stage
#4440 opened Apr 23, 2026 by sidsingh-nvidia Contributor Loading…
5 tasks
Core 0.16
6
Added NVFP4 MTP layer support
#4439 opened Apr 23, 2026 by sanandaraj5597 Contributor Loading…
1
docs: fix broken links and anchors across READMEs and docs docs-only documentation only (docs or docstrings)
#4438 opened Apr 23, 2026 by sbhavani Contributor Loading…
1 of 5 tasks
2
docs: fix Python version requirement and uv install commands in install docs-only documentation only (docs or docstrings)
#4437 opened Apr 23, 2026 by sbhavani Contributor Loading…
5 tasks
2
chore: nightly sync main into dev (22_04_2026) complexity: high Run functional tests
#4436 opened Apr 22, 2026 by svcnvidia-nemo-ci Loading… Core 0.16
7
Draft: Refactor APIs for FSDP2 Drop-in Compatibility module: megatron-fsdp
#4435 opened Apr 22, 2026 by shjwudp Contributor • Draft
5 tasks
@shjwudp @Autumn1998
1
get rid of weights_only=False complexity: low Expert Review [deprecated] Apply this label to indicate that your PR is ready for expert review. Final Review PR is in the "final review" stage Run functional tests
#4434 opened Apr 22, 2026 by dimapihtar Contributor Loading…
5 tasks
Core 0.16
2
fix cudagraph nonconvergence
#4433 opened Apr 22, 2026 by jiemingz Contributor • Draft
5 tasks
2
Adding code for Flextron complexity: high
#4429 opened Apr 22, 2026 by sheliang-nv Loading…
2 of 5 tasks
Core 0.16
@JRD971000
7
[DO NOT MERGE] Cye/mfsdp devgrad revert
#4428 opened Apr 22, 2026 by cspades Member • Draft
5 tasks
@cspades
1
[Main] Fix invisible issues related to use_decoupled_grad for Megatron-FSDP. complexity: low Final Review PR is in the "final review" stage
#4427 opened Apr 22, 2026 by cspades Member • Draft
5 tasks
Core 0.16
@cspades
4
[Dev] Fix invisible issues related to decoupled gradient for Megatron-FSDP.
#4426 opened Apr 22, 2026 by cspades Member • Draft
5 tasks
Core 0.16
@cspades
1
Add misc CUDA graph sugar to CudaGraphManager complexity: low
#4425 opened Apr 22, 2026 by tdene Contributor Loading…
5 tasks
Core 0.16
12
ProTip! Exclude everything labeled bug with -label:bug.