Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
357 commits
Select commit Hold shift + click to select a range
08c368a
test: re-enable test_pp2_create_cudagraphs_first_stage on TE 2.15+ (#…
ko3n1g May 26, 2026
6ce6fac
fix(tests): initialize num_microbatches calculator in vision cudagrap…
ko3n1g May 26, 2026
859b719
ci: Add allow_failure flag to gpt and moe recipes that are failing in…
balasaajay May 26, 2026
88e7ab0
Drain predecessor reduce-scatter at dispatch time (#4940)
deepakn94 May 27, 2026
e6b2bd8
nightly(ci): Update golden values for functional t5 tests (#4995)
balasaajay May 27, 2026
7521ecb
chore: rotate oncall schedule
github-actions[bot] May 27, 2026
873678a
[main] Refactor and Improve MoE Logginginit commit (#3431)
yanring May 27, 2026
4e52a9e
ci: validate release branch-rules (#4929)
ko3n1g May 27, 2026
67b2f38
[Megatron-FSDP] Add conditional param.grad dereferencing logic to sup…
cspades May 27, 2026
71223d5
test: restrict iter-time comparison to steady-state window (#5010)
ko3n1g May 27, 2026
2d10b8a
Add mHC support for HybridModel on dev (#4949)
Connor-XY May 27, 2026
a6d61fb
fix(test): pin eval-global-batch-size on 15b gb200 release configs (#…
ko3n1g May 27, 2026
286445c
[fix] Release MTP assertion when EP overlap with PP=1 (#4796)
Wohox May 27, 2026
0cb4034
fix(test): widen iter-time steady-state window for short tests (#5023)
ko3n1g May 27, 2026
805e24e
Perf fix (#4996)
shanmugamr1992 May 27, 2026
457e3f7
Add dev-feature preservation gate and change schedule (#4773)
Phlip79 May 27, 2026
146d171
chore(test): remove orphan nemotron3_super_release_g200 dir (#5024)
ko3n1g May 27, 2026
7be1748
Ignore Claude worktree directory (#5020)
Phlip79 May 27, 2026
9d23a73
Update copy-pr-bot.yaml [skip ci]
github-actions[bot] May 28, 2026
3e00820
ci: update CI workflow conditions for integration tests (#4658)
balasaajay May 28, 2026
0010683
Add NVSkills CI request workflow (#5033)
Phlip79 May 28, 2026
2a4f820
DDP wrap pg size fixes (#5006)
maanug-nv May 28, 2026
e0afe89
fix(layer_wise): tag MTP-stage word_embeddings as is_embedding_or_out…
Wohox May 28, 2026
7b9593b
[Dev] Add Qwen3 30B MoE recipes (#5012)
Victarry May 28, 2026
473145c
[DEV] fix(megatron-fsdp): reduce padding for grouped expert weights (…
xuwchen May 28, 2026
3e8ce1f
[Dev] fix(combined-1f1b): release loss-node input storage after combi…
Wohox May 28, 2026
35f36c7
[dev] [fix] [DeepSeek-v4] fix dense loss and rope type in DSv4 Hybrid…
hxbai May 28, 2026
4f2e7ce
Move LTS dependencies from pyproject.toml to Dockerfile.ci.lts (#4877)
balasaajay May 28, 2026
88efdf7
Use shared ModelOpt calibration loop on 0.45+ with 0.44 fallback fix …
kevalmorabia97 May 28, 2026
a5c2d1b
test(release): skip golden comparison on intermediate resume windows …
ko3n1g May 28, 2026
2ebca1e
[mimo] Thread position_ids through MimoModel for multimodal RoPE (#4938)
liding-nv May 28, 2026
e6ff4c3
build: Switch DSv3 on H100 to HybridEP (#5039)
ko3n1g May 28, 2026
ba9e0ea
Fix: Import unwrap_model from megatron.core.utils in modelopt example…
kevalmorabia97 May 28, 2026
3c39d98
Simple and stable Inference APIs (#4697)
YangFei1990 May 29, 2026
f63a46e
ci: Add notification step for MBridge downstream test results (#5028)
balasaajay May 29, 2026
58f3e67
[dev] [5/5] Qwen3.5 support: Qwen3.5-VL training example (#4751)
wplf May 29, 2026
1fe7825
chore: Update Docker image version to 26.04-py3 on dev (#5051)
ko3n1g May 29, 2026
f1b5516
Delete output tensor early (#4742)
Phlip79 May 29, 2026
f8e3885
Support ScaledSReLU in TE grouped MLP fuser (#4859)
sraman-rgb May 29, 2026
1801316
Skip gradient updates when grad norm exceeds threshold (#3460)
yfw May 29, 2026
6e0d14a
Add 9 user skills (#5066)
Phlip79 May 29, 2026
54dc530
test(nemotron): align nemotron3 super GB200 goldens with exit-interva…
ko3n1g May 30, 2026
6e091e1
chore: Update transformer-engine dependency to version 2.16.0 (#4992)
balasaajay May 30, 2026
52d1d68
Update energon version requirement (#4572)
maanug-nv May 30, 2026
791a45f
Fix test failures for new inference APIs (#5068)
YangFei1990 May 30, 2026
f33a51f
fix(ci): set PYTHONUNBUFFERED=1 in JET workload env (#5072)
ko3n1g May 30, 2026
378d81f
Preserve non-FSDP-unit buckets across AllGatherPipeline reset (#4717)
wujingyue May 30, 2026
3f6a2ed
Add opt-in MXFP8 LM-head output projection (#4825)
gdengk May 31, 2026
24cc2a8
chore(beep boop 🤖): Bump (main) (2026-06-01)
github-actions[bot] Jun 1, 2026
0a1726a
fix(ci): bound JET pipeline polling with a watchdog to prevent indefi…
ko3n1g Jun 1, 2026
595f697
ci: prune old artifacts on cluster lustre during weekly/release runs …
ko3n1g Jun 1, 2026
46f1af7
ci(test): isolate ckpt-resume tensorboard per phase (#5074)
ko3n1g Jun 1, 2026
33da12c
test: unmark EP A2A activation offload test flaky (#5009)
lhb8125 Jun 1, 2026
e656940
Change ownership groups (#5021)
Phlip79 Jun 1, 2026
496e1ff
test: skip mfsdp_fully_shard cases when world_size < mesh size (#4487)
wujingyue Jun 1, 2026
80cf756
fix mimo optimizer checkpoint metadata restore (#4791)
liding-nv Jun 1, 2026
de030fc
[mimo] Support bridge fan-out for variable modality tokens (#5062)
liding-nv Jun 1, 2026
b8dcaab
Add separate mtp_grad_scale_func for MTP loss scaling (#3459)
yfw Jun 1, 2026
5f88438
[training migration] Migrate GPT builder (#4741)
maanug-nv Jun 1, 2026
35992ba
Make Mamba conv params direct mixer params (#4899)
wujingyue Jun 1, 2026
907ebcd
Update copy-pr-bot.yaml [skip ci]
github-actions[bot] Jun 2, 2026
f5da5ea
Update oncall reviewer assignment (#5093)
Phlip79 Jun 2, 2026
bb192ff
Pass explicit process groups to hybrid logging (#4781)
yashaswikarnati Jun 2, 2026
7d9f259
Clean up top-level repository files (#5097)
Phlip79 Jun 2, 2026
b0eb914
[main] fix(moe): Fix several bugs for DSA rope and spec. (#3026)
yuzhongw-nvidia Jun 2, 2026
630956b
[Dev] Skip identity alltoall chunk sort (#5102)
lhb8125 Jun 2, 2026
c69697d
Move MIMO unit tests into models/mimo (#5063)
yashaswikarnati Jun 2, 2026
54e1996
test: update DeepSeek FSDP2 GB200 memory golden (#5094)
wujingyue Jun 2, 2026
a1ac2f6
Remove DeepEP hardware limit check (#4846)
janEbert Jun 2, 2026
591605e
Update transformer-engine dependency to revision 4220403 (#5112)
balasaajay Jun 2, 2026
44f254a
ci: make CI resilient to pip/uv network timeouts (#5118)
ko3n1g Jun 2, 2026
d94604e
ci: treat docker container-removal conflict as flaky (#5120)
ko3n1g Jun 2, 2026
655a064
Fix GDN DTensor splitting for FSDP checkpointing (#4843)
conver334 Jun 2, 2026
9ef8a2a
Fix MoE aux_loss / z_loss gradient scaling with TP > 1 (#5047)
deepakn94 Jun 2, 2026
540ff5d
Update copy-pr-bot.yaml [skip ci]
github-actions[bot] Jun 3, 2026
eac5ca7
Update Claude copy workflow to enforce user restrictions and improve …
balasaajay Jun 3, 2026
a823ea0
Add advisory process group guidance to Claude reviews (#5111)
yashaswikarnati Jun 3, 2026
3b6bc31
build: cap pydantic<2.14 in transformer-engine dependency metadata (#…
cuichenx Jun 3, 2026
20f5290
fix(test): skip scalar-less tensorboard event files in resume checks …
ko3n1g Jun 3, 2026
64c3fb8
chore: rotate oncall schedule
github-actions[bot] Jun 3, 2026
c2a3bec
docs: fix contributor guide typo (#4858)
LeSingh1 Jun 3, 2026
4d104fd
ci(unit-tests): split slow unit-test buckets over 15min SLA (#5133)
ko3n1g Jun 3, 2026
ec97c85
Fix DSA indexer loss not averaged across micro-batches (#4070)
kaimo455 Jun 3, 2026
7a7f7b4
Update MINOR version to 19 (#5096)
balasaajay Jun 3, 2026
947d6ae
Fix Muon QKV split for gated attention (#4728)
Moozy23232 Jun 3, 2026
ffd66a3
Roll input IDs for MTP labels (#3457)
yfw Jun 3, 2026
b8fef11
Refactor: Move paged stashing Triton kernels (#5003)
Phlip79 Jun 3, 2026
a377dee
Adding blackwell tests (#5113)
shanmugamr1992 Jun 3, 2026
d9bd342
Relax atol for test_router_gating_linear router_dtype=torch.float32 (…
adityasingh2400 Jun 3, 2026
e513ec4
Fix incorrect inference metadata tensor dtypes (#4855)
santhnm2 Jun 3, 2026
168cb15
Disable TE cross entropy loss fusion (#5115)
mchrzanowski Jun 3, 2026
b80a854
fix(optimizer): gate ChainedOptimizer MXFP8 defer-sync on DDP-level o…
ko3n1g Jun 3, 2026
669b747
Update copy-pr-bot.yaml [skip ci]
github-actions[bot] Jun 4, 2026
4a47b16
Pass TP group to unfused cross entropy (#5128)
yashaswikarnati Jun 3, 2026
60ef5e2
fix: correct dsv4_hybrid Q-up FLOPs by using args.v_head_dim (#5142)
dingqingy-nv Jun 4, 2026
05a93e0
[dev] [follow-up] Qwen3.5 support: MoE aux loss padding_mask (#4776)
wplf Jun 4, 2026
d23ca85
[Dev] Support isolated MTP loss (#5080)
Victarry Jun 4, 2026
471e3e3
test(elastification): quarantine flaky test_gumbel_determinism as fla…
ko3n1g Jun 4, 2026
bdcaf26
ci(notify): mention mcore-oncall and philipp on critical CI events (#…
ko3n1g Jun 4, 2026
16b7194
Change the cudagraph distribution from linearly to exponentially-decr…
mathemakitten Jun 4, 2026
4108d12
ci: Disable a few gb200 test cases to support 2 branches. (#5151)
balasaajay Jun 4, 2026
53e3748
build: Switch DSv3 on H100 to HybridEP (#5164)
balasaajay Jun 4, 2026
d041544
Add MTP acceptance rate metrics (#3458)
yfw Jun 4, 2026
6f14bf9
Nemotron Ultra config for ModelOpt examples (#5159)
jenchen13 Jun 4, 2026
53b5e6e
Make MTP / prefix cache stats persist for engine lifetime (#4101)
santhnm2 Jun 4, 2026
2944537
Restore Greptile configuration (#5166)
Phlip79 Jun 4, 2026
96a894e
chore: bump `_code_freeze` workflow to `v1.4.2` (#5132)
ko3n1g Jun 4, 2026
cefc252
[dev] moe(fix): Avoid TE cuda graph dummy attention masks (#5131)
yuzhongw-nvidia Jun 5, 2026
5a2b598
ci: Remove docs build test in favor of release test (#5182)
chtruong814 Jun 5, 2026
b574499
Move TE cross entropy guard to training args (#5162)
yaoyu-33 Jun 5, 2026
5a2c6fa
Fix error in deepseek parser (#5136)
tdene Jun 5, 2026
9d33299
Fix logprob slicing for 0 generated token case (#5167)
santhnm2 Jun 5, 2026
0f891a1
[Perf] Fold frozen linear dgrad matmul (#5092)
cuichenx Jun 5, 2026
53d9ba0
Clamp `max_new_tokens` in MInf to mirror vllm (#5181)
tdene Jun 5, 2026
dbf5228
build: add managed = true to [tool.uv] (#5190)
kajalj22 Jun 5, 2026
6204b92
Stabilize GB200 inference perf tests against cold-start noise (#5171)
shanmugamr1992 Jun 5, 2026
ae1fc65
chore: nightly sync main into dev (06_06_2026)
github-actions[bot] Jun 6, 2026
06f659b
fix: post-CI corrections (docs dup fields, nvrx version gate, utils r…
github-actions[bot] Jun 6, 2026
ca1253c
[dev] [DeepSeek-v4] Add ClampedSwiGLU to MoE mlp_op_fuser and add for…
hxbai Jun 7, 2026
12fc125
Merge current dev into nightly sync
Phlip79 Jun 8, 2026
947c0b3
nvidia style guide audit for getting started folder (#5168)
megnvidia Jun 8, 2026
05c76af
AI aided audit for Nvidia Style guidance (#5141)
megnvidia Jun 8, 2026
ff5264c
Enable selective recompute for `norm_out` in GDN layers (#4715)
xuantengh Jun 8, 2026
adcdf16
fix(elastification): align with get_batch + utils refactors (#5194)
balasaajay Jun 8, 2026
5da641c
fix(combined-1f1b): release loss-node input storage after combined ba…
Wohox Jun 8, 2026
959a542
Minor improvements for Dynamic-cp (#4226)
xiaoyao0115 Jun 8, 2026
fb1e6d7
fix: post-CI corrections
Phlip79 Jun 8, 2026
dbf719b
chore(beep boop 🤖): Bump (main) (2026-06-08)
github-actions[bot] Jun 8, 2026
17a5a80
Avoid stat syscall in rerun result validation (#5107)
dimapihtar Jun 8, 2026
71e2246
docs: Update Latest News in README.md (#3790)
sbhavani Jun 8, 2026
0af5708
Merge remote-tracking branch 'origin/dev' into main2dev/06_06_2026
Phlip79 Jun 8, 2026
3e6e32b
Fix bug with Megatron-FSDP zero counter not working with decoupled gr…
cspades Jun 8, 2026
39f8d55
varlendataset for thd e2e and benchmark (#4832)
xiaoyao0115 Jun 8, 2026
1829fd9
ci: add smoke tests (#5143)
balasaajay Jun 8, 2026
71e418e
Add mtp_detach_heads config to detach MTP head inputs (#3456)
yfw Jun 8, 2026
179df43
fix: wrap mtp logging comment
Phlip79 Jun 8, 2026
a95d866
docs: fix install guide NGC container anchor (#5224)
Connor-XY Jun 9, 2026
5f37f45
[Dev] Add separate toggle for varlen input padding for HybridEP in TH…
zhongbozhu Jun 9, 2026
48032d7
Fuse per-sequence AlltoAll into a unified one in GDN forward (#4913)
xuantengh Jun 9, 2026
5788a20
Merge remote-tracking branch 'origin/dev' into main2dev/06_06_2026
Phlip79 Jun 8, 2026
3920476
Apply MIMO SP/CP sharding with explicit groups and enable THD in non-…
yashaswikarnati Jun 9, 2026
d199bb9
Fix CUDA IMA in fsdp_double_buffer when an FSDP unit's bucket doesn't…
wujingyue Jun 9, 2026
ba71ec2
Add named layouts to HyperCommGrid for heterogeneous parallelism (#5148)
yashaswikarnati Jun 9, 2026
2f10049
chore: nightly sync main into dev (06_06_2026) (#5199)
balasaajay Jun 9, 2026
55638bc
Fix wgrad race condition when using double buffers. (#5222)
cspades Jun 10, 2026
504b02f
Move uneven DTensor distributed fixture to conftest (#5237)
wujingyue Jun 10, 2026
b180d2c
Route bridge communicator cross-grid P2P through a dedicated process …
yashaswikarnati Jun 10, 2026
e03878b
Fix test_split_tensor_along_last_dim to actually assert correctness (…
lichenlu Jun 10, 2026
2065b5a
chore: rotate oncall schedule
github-actions[bot] Jun 10, 2026
c6af841
Add optional group= to common_utils model/data-parallel reduction hel…
yashaswikarnati Jun 10, 2026
8baac4d
ci: Allow DCO check in merge queue and add DCO requirement to Contrib…
chtruong814 Jun 10, 2026
84d8bfe
Update copy-pr-bot.yaml [skip ci]
github-actions[bot] Jun 11, 2026
aa10571
Add MIMO hetero topology + distributed bootstrap (examples/mimo train…
yashaswikarnati Jun 10, 2026
3a183e2
Remove checkpoint-time GPU cache reclaim workaround (#5170)
shurkat-nvidia Jun 11, 2026
89ad096
[Dev] DeepSeek-V4-Flash recipe 20260610 (#5266)
hxbai Jun 11, 2026
694cb0d
[Dev] Generalized fix for mxfp8 param gather (#4994)
zhongbozhu Jun 11, 2026
7eedac5
[Dev] Cherry-pick MTP detach heads (#5223)
Victarry Jun 11, 2026
0e0814a
[TE] Restore original CP group after dynamic CP forward in TEDotProdu…
rui23 Jun 11, 2026
192cbc3
[examples] Add dynamic context parallel benchmark example (#5123)
ilml Jun 11, 2026
1af933d
Remove duplicate nccl_allocator import (#5057)
returnL Jun 11, 2026
08518ad
[dev] Add experimental Megatron Lite as agentic exploration (#4885)
ISEEKYAN Jun 11, 2026
930bb6f
fix(ci): resolve t5 dataloader stall + GRPO cudagraph-memory regressi…
Connor-XY Jun 11, 2026
d81b638
Fix Dockerfile warnings (#4856)
janEbert Jun 11, 2026
76d26e2
Fix fused MLA delayed weight grad hooks (#5273)
sraman-rgb Jun 11, 2026
5321c66
ci: limit retries on unsuccessful test launches (#5275)
balasaajay Jun 11, 2026
75e382c
Thread pg_collection into get_model DDP bucket sizing (#5250)
yashaswikarnati Jun 11, 2026
5ccd936
Enable non-deterministic results in model configuration for nemotron …
balasaajay Jun 11, 2026
bd1f0dd
Stabilize hybrid nanov3 gb200 perf (#5295)
shanmugamr1992 Jun 11, 2026
5b16c99
Clip mtp grads separately when mtp_detach_heads=True (#4116)
yfw Jun 11, 2026
de6305c
Thread pg_collection into train_step reductions (#5259)
yashaswikarnati Jun 11, 2026
ae955ca
Merge remote-tracking branch 'origin/main' into main2dev/12_06_2026
svcnvidia-nemo-ci Jun 12, 2026
c700379
ci: Allow DCO check in merge queue and add DCO requirement (#5305)
balasaajay Jun 12, 2026
b0d49c9
fix: restore dev-only training.py features dropped by the main override
svcnvidia-nemo-ci Jun 12, 2026
9d46c92
[dev]: faster implementation of mHC fused kernels (#4624)
jingqiny-99 Jun 12, 2026
df9141e
Allow for pre-bound socket to be passed in server (#5301)
tdene Jun 12, 2026
277c4f8
Offline Logits-Based Knowledge Distillation (#5019)
AAnoosheh Jun 12, 2026
1f537e8
Handle None values in sampling parameters (#5300)
tdene Jun 12, 2026
c0c1f91
Add moe loss normalization for RL SFT (#3956)
pthombre Jun 12, 2026
18a2f55
Add code owners for optimizer-related files (#5297)
janEbert Jun 12, 2026
b45ae73
Fix EP=1 inference by allocating buffers anyway (#5233)
mathemakitten Jun 12, 2026
806022f
Fix crash due to tool call at sequence length (#5302)
tdene Jun 13, 2026
ef549a6
Inference: Cudagraph-aware admission gating in prefill scheduler (#4870)
mathemakitten Jun 13, 2026
0022550
Account for reasoning token stripping (#5313)
tdene Jun 13, 2026
eb1c677
Thread pg_collection through wrap_model_chunks_with_ddp (#5328)
yashaswikarnati Jun 13, 2026
e5ad098
[Dev] Add MoE recipe performance summary (#5289)
Victarry Jun 15, 2026
c049020
[Dev] Add DeepEP v2 flex dispatcher backend (#4793)
Autumn1998 Jun 15, 2026
15a4ffc
fix tflops calculation when sequence_packing_scheduler is not none (#…
xiaoyao0115 Jun 15, 2026
59bb1c1
chore(beep boop 🤖): Bump (main) (2026-06-15)
github-actions[bot] Jun 15, 2026
3d8b95c
[dev] bump emerging optimizers to v0.3.0 (#5320)
FDecaYed Jun 15, 2026
1bcb3b9
Fix LatentMoE theoretical memory estimate (#5145)
Wong4j Jun 15, 2026
0302fac
Merge branch 'dev' into main2dev/12_06_2026
Phlip79 Jun 15, 2026
133cf60
Add zstandard package to Docker LTS requirements. Fix nightly failure…
balasaajay Jun 15, 2026
95654c9
fix: preserve seqlen stats in train_step
Phlip79 Jun 15, 2026
addc601
Thread MIMO support through the stock training loop (schedule + optim…
yashaswikarnati Jun 15, 2026
377b2e0
Enable Deepseek-v4 hybrid_model in dev branch Part (1/N) (#5042)
guihong-nv Jun 16, 2026
b6bea7e
chore: nightly sync main into dev (12_06_2026) (#5314)
balasaajay Jun 16, 2026
8dc6e66
feat(ssm): whole-module 'gdn' selective recompute for GatedDeltaNet (…
wplf Jun 16, 2026
232c478
[Fix] Fix optimizer parameter override bugs. (#5213)
Baibaifan Jun 16, 2026
2047dec
[Dev] Add Megatron-FSDP weight prefetch for full recompute (#5175)
lhb8125 Jun 16, 2026
4165673
ci: default functional test time limit to 4h for release/weekly scope…
ko3n1g Jun 16, 2026
7f91752
[Dev] add cuda graph support for thd format training. (#4359)
HaochenYuan Jun 16, 2026
72171c0
Fix memory leak with log_max_attention_logit (#4699) (#5067)
asolergi-nv Jun 16, 2026
b60de39
Clean up pretrain_gpt.py and pretrain_hybrid.py formatting and remove…
ilml Jun 16, 2026
1cfa834
Add full model cuda graph support for MTP inference (#4950)
santhnm2 Jun 16, 2026
a83f408
Expand the Mamba prefix caching memory safety check to include scratc…
santhnm2 Jun 16, 2026
b00cad1
Make Megatron RL only materialize last token logit (#4551)
tdene Jun 16, 2026
a12484b
Profiling (#3110)
jalbericiola Jun 16, 2026
2b90b3f
Support fused MLA QKV checkpoint reload (#5310)
sraman-rgb Jun 16, 2026
000dc1c
Add minimal DBuffer implementation (#4835)
wujingyue Jun 16, 2026
9af7c79
[Dev] restore DSv4 tflops calc in training and fix the packed seq cas…
hxbai Jun 16, 2026
d30e165
[split 1/5] Fix packed THD RoPE under CP (#5243)
HollowMan6 Jun 17, 2026
49737fd
Update copy-pr-bot.yaml [skip ci]
github-actions[bot] Jun 17, 2026
2e1183a
Document agent PR commit sign-off and signing (#5381)
wujingyue Jun 16, 2026
2463dbe
Remove unused distributed pytest markers (#5380)
wujingyue Jun 17, 2026
5c660c3
[feat] Support fine-grained activation offloading in fused group mlp …
lhb8125 Jun 17, 2026
bd381ac
Thread tensor-parallel group into the RADIO patch embedder (#5371)
yashaswikarnati Jun 17, 2026
a00c0de
Add MimoModel.zero_grad_buffer delegating to active DDP submodules (#…
yashaswikarnati Jun 17, 2026
7604f28
[split 3/5] Refactor absorbed MLA projection handling (#5245)
HollowMan6 Jun 17, 2026
3346fa8
[dev] moe(perf): Restore fused GDN THD all-to-all on dev (#5389)
yuzhongw-nvidia Jun 17, 2026
5182aa6
chore: rotate oncall schedule
github-actions[bot] Jun 17, 2026
41dbab4
ci: Remove sync skills workflow (#5091)
chtruong814 Jun 17, 2026
ad5a93b
Add flaky marker to fine-grained activation offloading test (#5350) (…
balasaajay Jun 17, 2026
be82829
Revert "Remove checkpoint-time GPU cache reclaim workaround (#5170)" …
balasaajay Jun 18, 2026
a50252b
Update goldens for weekly tests after pytorch and TE bumps. (#5399)
balasaajay Jun 18, 2026
d1410e1
Add MIMO runtime setup: per-role RNG seeding and DDP wrapping (#5285)
yashaswikarnati Jun 18, 2026
6142ee4
Add --mamba-training-ssm-states-dtype argument (#5309)
tdene Jun 21, 2026
2cb1b80
chore(beep boop 🤖): Bump (main) (2026-06-22)
github-actions[bot] Jun 22, 2026
57c484e
Fix Mamba prefix match for chunked prefill (#4758)
lmcafee-nvidia Jun 22, 2026
ae2efd5
Disag MR2: Refit into multiple destination pools and tied-embedding +…
wdykas Jun 22, 2026
fc4597c
Disag MR1: Add inference shard specs and pg-collection building (#5186)
wdykas Jun 22, 2026
c2a9a60
Merge remote-tracking branch 'origin/main' into main2dev/22_06_2026
github-actions[bot] Jun 22, 2026
3fae48f
[Fix] Fix MoE router z-loss compatibility with TE CUDA Graph capture.…
Baibaifan Jun 23, 2026
94f70b6
test: mark ep_a2a_overlap activation-offloading test flaky_in_dev (#5…
ko3n1g Jun 23, 2026
8c0aa6c
test: mark TestParallelTransformerBlockCudagraphs::test_gpu_cudagraph…
ko3n1g Jun 24, 2026
6c6ce4e
test: mark gated_delta_net selective-recompute test flaky_in_dev (#5476)
ko3n1g Jun 24, 2026
cc083e1
fix: post-CI corrections for sync test/impl reconciliation
github-actions[bot] Jun 22, 2026
15486f7
fix sequence packing wrapper for eval (#5483)
xiaoyao0115 Jun 25, 2026
4463f78
[dev] Megatron Lite (4/4) shared attention (#5427)
ISEEKYAN Jun 25, 2026
f6c77e7
fix: restore fused group MLP offload in main2dev sync (#5493)
lhb8125 Jun 25, 2026
72cef25
chore: nightly sync main into dev (22_06_2026) (#5430)
chtruong814 Jun 26, 2026
056d9c0
[dev] [DeepSeek-v4] Packed Sequence (THD) support for DSv4 Hybrid Att…
hxbai Jun 26, 2026
d2e7ec5
Improve default dynamic CP packing scheduler (#5154)
xiaoyao0115 Jun 26, 2026
d963266
[dev] moe(perf): Pre-GDR kernel fusion (#5361)
yuzhongw-nvidia Jun 27, 2026
04bbfe6
Preserve DSA output across fused inverse RoPE (#5526)
kunlunl Jun 29, 2026
3e89f3c
Enable Deepseek-v4 hybrid_model in dev branch Part (2/N) (#5485)
guihong-nv Jun 29, 2026
3b9c248
[dev] Add experimental decoupled compact LayerWise DDP layout for Muo…
Wohox Jun 30, 2026
5e846ab
[dev] Sync Megatron Lite with the latest implementation (#5577)
ISEEKYAN Jul 1, 2026
66dc96f
[Dev] fix padding mask docstring (#5598)
HaochenYuan Jul 2, 2026
e3021f9
Merge remote-tracking branch 'nvidia/dev' into mfsdp_refactor_dev_ups…
shjwudp Jul 2, 2026
9d733b7
handle split_dtensor
shjwudp Jul 2, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
39 changes: 0 additions & 39 deletions .coderabbit.yaml

This file was deleted.

4 changes: 0 additions & 4 deletions .flake8

This file was deleted.

4 changes: 2 additions & 2 deletions .github/ISSUE_TEMPLATE/bug_report.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ assignees: ''

**Describe the bug**

A clear and concise description of what the bug is. Tag the [@mcore-oncall](https://github.com/orgs/NVIDIA/teams/mcore-oncall)
A clear and concise description of what the bug is. Tag @NVIDIA/mcore-oncall
to get oncall's attention to this issue.

**Steps/Code to reproduce bug**
Expand All @@ -26,4 +26,4 @@ A clear and concise description of what you expected to happen.

**Additional context**

Add any other context about the problem here.
Add any other context about the problem here.
2 changes: 1 addition & 1 deletion .github/ISSUE_TEMPLATE/feature_request.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ assignees: ''
**Is your feature request related to a problem? Please describe.**
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Tag the [@mcore-oncall](https://github.com/orgs/NVIDIA/teams/mcore-oncall)
Tag @NVIDIA/mcore-oncall
to get oncall's attention to this issue.

**Describe the solution you'd like**
Expand Down
4 changes: 2 additions & 2 deletions .github/ISSUE_TEMPLATE/question.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,5 +9,5 @@ assignees: ''
---

**Your question**
Ask a clear and concise question about Megatron-LM. Tag the [@mcore-oncall](https://github.com/orgs/NVIDIA/teams/mcore-oncall)
to get oncall's attention to this issue.
Ask a clear and concise question about Megatron-LM. Tag @NVIDIA/mcore-oncall
to get oncall's attention to this issue.
2 changes: 1 addition & 1 deletion .github/ISSUE_TEMPLATE/regression.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ assignees: ''
---

**Describe the regression**
A clear and concise description of what the regression is. Tag the [@mcore-oncall](https://github.com/orgs/NVIDIA/teams/mcore-oncall)
A clear and concise description of what the regression is. Tag @NVIDIA/mcore-oncall
to get oncall's attention to this issue.

**To Reproduce**
Expand Down
32 changes: 29 additions & 3 deletions .github/actions/action.yml
Original file line number Diff line number Diff line change
Expand Up @@ -65,6 +65,10 @@ inputs:
description: "Trigger cadence for cadence filter (pr|nightly|mergegroup). Empty disables filter."
required: false
default: ""
sha:
description: "Git ref to check out. Must match the SHA used by the upstream parse step so recipes don't diverge between scheduling and execution."
required: false
default: ""
runs:
using: "composite"
steps:
Expand All @@ -74,10 +78,20 @@ runs:

- name: Checkout repository
uses: actions/checkout@v6
with:
ref: ${{ inputs.sha }}

- name: Change ownership of /home/runner/
shell: bash
run: sudo chown -R $(whoami) /home/runner/
# Tolerate vanishing `.git/objects/pack/.tmp-*` files: the prior
# `actions/checkout` may leave a background `git gc --auto` running,
# whose `git pack-objects` renames/deletes temp files while `chown`
# is walking the tree. On failure, wait 5 s for gc to settle, retry,
# then succeed unconditionally.
run: |
sudo chown -R $(whoami) /home/runner/ 2>/dev/null && exit 0
sleep 5
sudo chown -R $(whoami) /home/runner/ 2>/dev/null || true

- name: Setup python
uses: actions/setup-python@v5
Expand Down Expand Up @@ -113,6 +127,9 @@ runs:
export PYTHONPATH=$(pwd)
export NEMORUN_HOME=$(pwd)
export NCCL_DEBUG=INFO
export PIP_DEFAULT_TIMEOUT=120
export PIP_RETRIES=5
export UV_HTTP_TIMEOUT=120
uv venv .venv
uv cache clean
uv sync --no-cache --only-group test
Expand Down Expand Up @@ -155,6 +172,9 @@ runs:

export PYTHONPATH=$(pwd)
export NEMORUN_HOME=$(pwd)
export PIP_DEFAULT_TIMEOUT=120
export PIP_RETRIES=5
export UV_HTTP_TIMEOUT=120
uv venv .venv
uv cache clean
uv sync --no-cache --only-group test
Expand Down Expand Up @@ -209,6 +229,8 @@ runs:
if: always()
env:
IS_UNIT_TEST: ${{ inputs.is_unit_test == 'true' }}
MAIN_CONCLUSION: ${{ steps.run-main-script.conclusion }}
MAIN_EXIT_CODE: ${{ steps.run-main-script.outputs.exit_code }}
run: |
logs_report=logs-${{ inputs.test_case }}-${{ github.run_id }}-$(cat /proc/sys/kernel/random/uuid)
echo "logs_report=$logs_report" | sed 's/\//-/g' | sed 's/\*/-/g' | tee -a "$GITHUB_OUTPUT"
Expand All @@ -219,8 +241,12 @@ runs:
fi
echo "coverage_report=$coverage_report" | tee -a "$GITHUB_OUTPUT"

EXIT_CODE=${{ steps.run-main-script.outputs.exit_code }}
IS_SUCCESS=$([[ "$EXIT_CODE" -eq 0 ]] && echo "true" || echo "false")
EXIT_CODE="${MAIN_EXIT_CODE:-${MAIN_CONCLUSION}}"
if [[ "$MAIN_CONCLUSION" == "success" ]]; then
IS_SUCCESS=true
else
IS_SUCCESS=false
fi

if [[ "$IS_SUCCESS" == "false" && "${{ inputs.is-optional }}" == "true" ]]; then
echo "::warning::Test failed but is marked optional — treating as success."
Expand Down
2 changes: 1 addition & 1 deletion .github/copy-pr-bot.yaml
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
enabled: true
auto_sync_draft: false
auto_sync_ready: true
trustees_override: ["AAnoosheh", "ArEsKay3", "Autumn1998", "BestJuly", "BoxiangW", "CarlosGomes98", "ChenhanYu", "Connor-XY", "FDecaYed", "HaochenYuan", "ISEEKYAN", "JRD971000", "Mellonta", "Phlip79", "QiZhangNV", "RPrenger", "ShriyaRishab", "Victarry", "WanZzzzzz", "Wohox", "YangFei1990", "ZhiyuLi-Nvidia", "ahmadki", "aklife97", "ananthsub", "aroshanghias-nvd", "asolergi-nv", "balasaajay", "buptzyb", "chtruong814", "cjld", "cspades", "cuichenx", "deepakn94", "dimapihtar", "dingqingy-nv", "duncanriach", "erhoo82", "ericharper", "fanshiqing", "faradawn", "fitsumreda", "frsun-nvda", "gautham-kollu", "gdengk", "guihong-nv", "guyueh1", "hexinw-nvidia", "huvunvidia", "hxbai", "ilml", "jalbericiola", "janEbert", "jaredcasper", "jenchen13", "jiemingz", "jingqiny-99", "jkamalu", "jon-barker", "jstjohn", "kajalj22", "kanz-nv", "kevalmorabia97", "ko3n1g", "ksivaman", "kunlunl", "kvareddy", "kwyss-nvidia", "layalir", "lhb8125", "lmcafee-nvidia", "maanug-nv", "mathemakitten", "matthieule", "mchrzanowski", "mehraakash", "minitu", "mkhona-nvidia", "nanz-nv", "ntajbakhsh", "parthmannan", "prajwal1210", "pthombre", "rhewett-nv", "rogerwaleffe", "sajadn", "sanandaraj5597", "sancha", "santhnm2", "sbak5", "shanmugamr1992", "sharathts", "sheliang-nv", "shengf-nv", "shifangx", "shjwudp", "sidsingh-nvidia", "skyw", "sraman-rgb", "sudhakarsingh27", "tdene", "theothermike", "thomasdhc", "tomlifu", "trintamaki", "tylerpoon", "wdykas", "wplf", "wujingyue", "xiaoyao0115", "xuantengh", "xuwchen", "yanring", "yaox12", "yaoyu-33", "yashaswikarnati", "yeyu-nvidia", "yobibyte", "youngeunkwon0405", "yueshen2016", "yuzhongw-nvidia", "zhongbozhu"]
trustees_override: ["AAnoosheh", "ArEsKay3", "Autumn1998", "BestJuly", "BoxiangW", "CarlosGomes98", "ChenhanYu", "Connor-XY", "FDecaYed", "HaochenYuan", "ISEEKYAN", "JRD971000", "Mellonta", "Phlip79", "QiZhangNV", "RPrenger", "ShriyaRishab", "Victarry", "WanZzzzzz", "Wohox", "YangFei1990", "ZhiyuLi-Nvidia", "adistomar", "ahmadki", "aklife97", "alokpathy", "ananthsub", "anlthms", "aroshanghias-nvd", "ashehper", "asolergi-nv", "athitten", "balasaajay", "buptzyb", "chtruong814", "cjld", "cspades", "cuichenx", "deepakn94", "dimapihtar", "dingqingy-nv", "duncanriach", "erhoo82", "ericharper", "fanshiqing", "faradawn", "fitsumreda", "frsun-nvda", "gautham-kollu", "gdengk", "guihong-nv", "guyueh1", "hexinw-nvidia", "huvunvidia", "hxbai", "ilml", "jalbericiola", "janEbert", "jaredcasper", "jenchen13", "jiemingz", "jingqiny-99", "jkamalu", "jon-barker", "jstjohn", "kajalj22", "kamran-nvidia", "kevalmorabia97", "ko3n1g", "ksivaman", "kunlunl", "kvareddy", "kwyss-nvidia", "layalir", "lhb8125", "liding-nv", "lmcafee-nvidia", "maanug-nv", "macandro96", "mathemakitten", "matthieule", "mchrzanowski", "mehraakash", "minitu", "mkhona-nvidia", "nanz-nv", "ntajbakhsh", "parthmannan", "philipcmonk", "prajwal1210", "pthombre", "rapatel", "rhewett-nv", "rogerwaleffe", "sajadn", "sanandaraj5597", "sancha", "santhnm2", "sbak5", "shanmugamr1992", "sharathts", "sheliang-nv", "shengf-nv", "shifangx", "shjwudp", "sidsingh-nvidia", "skyw", "sraman-rgb", "sudhakarsingh27", "tdene", "theothermike", "thomasdhc", "tomlifu", "trintamaki", "tylerpoon", "wdykas", "wplf", "wujingyue", "xiaoyao0115", "xuantengh", "xuwchen", "yaox12", "yaoyu-33", "yashaswikarnati", "yeyu-nvidia", "yobibyte", "youngeunkwon0405", "yueshen2016", "yuzhongw-nvidia", "zhongbozhu"]
42 changes: 21 additions & 21 deletions .github/oncall_schedule.json
Original file line number Diff line number Diff line change
@@ -1,50 +1,50 @@
[
{
"user": "janEbert",
"date": "2026-05-06"
"user": "Phlip79",
"date": "2026-06-17"
},
{
"user": "dimapihtar",
"date": "2026-05-13"
"user": "asolergi-nv",
"date": "2026-06-24"
},
{
"user": "ilml",
"date": "2026-05-20"
"user": "maanug-nv",
"date": "2026-07-01"
},
{
"user": "wujingyue",
"date": "2026-05-27"
"date": "2026-07-08"
},
{
"user": "Connor-XY",
"date": "2026-06-03"
"date": "2026-07-15"
},
{
"user": "guihong-nv",
"date": "2026-06-10"
"user": "Phlip79",
"date": "2026-07-22"
},
{
"user": "Phlip79",
"date": "2026-06-17"
"user": "YangFei1990",
"date": "2026-07-29"
},
{
"user": "asolergi-nv",
"date": "2026-06-24"
"date": "2026-08-05"
},
{
"user": "maanug-nv",
"date": "2026-07-01"
"user": "dimapihtar",
"date": "2026-08-12"
},
{
"user": "wujingyue",
"date": "2026-07-08"
"user": "guihong-nv",
"date": "2026-08-19"
},
{
"user": "Connor-XY",
"date": "2026-07-15"
"user": "ilml",
"date": "2026-08-26"
},
{
"user": "Phlip79",
"date": "2026-07-22"
"user": "janEbert",
"date": "2026-09-02"
}
]
13 changes: 4 additions & 9 deletions .github/pull_request_template.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,9 @@
- [ ] I, the PR author, have personally reviewed every line of this PR.

# What does this PR do ?
<!-- Add a one line overview of what this PR aims to accomplish. -->

:warning: For major changes (either in lines of code or in its impact), please make sure to first share a design doc with the team. If you're unsure what's the best way to do so, contact the @mcore-oncall.
:warning: For major changes (either in lines of code or in its impact), please make sure to first share a design doc with the team. If you're unsure what's the best way to do so, contact @NVIDIA/mcore-oncall.

## Issue tracking

Expand All @@ -24,7 +26,7 @@ Linked issue: <!-- e.g. Fixes #1234 / Related to #1234 -->

### Code review

Feel free to message or comment the [@mcore-oncall](https://github.com/orgs/NVIDIA/teams/mcore-oncall) to help accelerate your merge into main. The less complex your PR is, the faster it will be approved and merged!
Feel free to message or comment @NVIDIA/mcore-oncall to help accelerate your merge into main. The less complex your PR is, the faster it will be approved and merged!

All PRs start as **draft**. If you open a non-draft PR, it will be automatically converted to draft.

Expand All @@ -50,10 +52,3 @@ Once all required reviewers have approved, the `Approved` label is applied **aut
### Merge

Any member of [mcore-engineers](https://github.com/orgs/NVIDIA/teams/mcore-engineers) will be able to merge your PR.

<details>
<summary>For MRs into `dev` branch</summary>
The proposed review process for `dev` branch is under active discussion.

MRs are mergable after one approval by either `eharper@nvidia.com` or `zijiey@nvidia.com`.
</details>
Loading