Skip to content

From NVIDIA Megatron-LM for visibility#18

Open
RaymondLi0 wants to merge 7360 commits into
bigcode-project:multi-query-attentionfrom
NVIDIA:main
Open

From NVIDIA Megatron-LM for visibility#18
RaymondLi0 wants to merge 7360 commits into
bigcode-project:multi-query-attentionfrom
NVIDIA:main

Conversation

@RaymondLi0

@RaymondLi0 RaymondLi0 commented Jan 24, 2023

Copy link
Copy Markdown
Collaborator

No description provided.

@RaymondLi0
RaymondLi0 changed the base branch from multi-query-attention to before-merge June 20, 2023 20:12
@RaymondLi0
RaymondLi0 changed the base branch from before-merge to multi-query-attention June 20, 2023 20:12
ko3n1g and others added 27 commits June 4, 2026 10:17
@ko3n1g @claude
ci(notify): mention mcore-oncall and philipp on critical CI events (#…
bdcaf26 
…5152)

Signed-off-by: oliver könig <okoenig@nvidia.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@mathemakitten
Change the cudagraph distribution from linearly to exponentially-decr…
16b7194 
…easing + grid for mixed prefill (#3509)
@balasaajay
ci: Disable a few gb200 test cases to support 2 branches. (#5151)
4108d12
@balasaajay
build: Switch DSv3 on H100 to HybridEP (#5164)
53e3748
@yfw @claude
Add MTP acceptance rate metrics (#3458)
d041544 
Signed-off-by: Yi-Fu Wu <yifu.wu@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@jenchen13
Nemotron Ultra config for ModelOpt examples (#5159)
6f14bf9 
Signed-off-by: Jennifer Chen <jennifchen@nvidia.com>
@santhnm2 @claude
Make MTP / prefix cache stats persist for engine lifetime (#4101)
53b5e6e 
Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
@Phlip79
Restore Greptile configuration (#5166)
2944537
@ko3n1g
chore: bump _code_freeze workflow to v1.4.2 (#5132)
96a894e 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@chtruong814
ci: Remove docs build test in favor of release test (#5182)
5a2b598 
Signed-off-by: Charlie Truong <chtruong@nvidia.com>
@yaoyu-33
Move TE cross entropy guard to training args (#5162)
b574499 
Signed-off-by: yaoyu-33 <yaoyu.094@gmail.com>
@tdene
Fix error in deepseek parser (#5136)
5a2c6fa
@santhnm2
Fix logprob slicing for 0 generated token case (#5167)
9d33299 
Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com>
@cuichenx
[Perf] Fold frozen linear dgrad matmul (#5092)
0f891a1 
Signed-off-by: Chen Cui <chcui@nvidia.com>
@tdene
Clamp max_new_tokens in MInf to mirror vllm (#5181)
53d9ba0
@kajalj22
build: add managed = true to [tool.uv] (#5190)
dbf5228 
Signed-off-by: Kajal Jain <kajalj@nvidia.com>
@shanmugamr1992 @claude
Stabilize GB200 inference perf tests against cold-start noise (#5171)
6204b92 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@megnvidia
nvidia style guide audit for getting started folder (#5168)
947c0b3 
Signed-off-by: meg miranda <mmiranda@nvidia.com>
@megnvidia @Phlip79
AI aided audit for Nvidia Style guidance (#5141)
05c76af 
Signed-off-by: meg miranda <mmiranda@nvidia.com>
Co-authored-by: Philip Petrakian <pgpetrak@gmail.com>
@xuantengh
Enable selective recompute for norm_out in GDN layers (#4715)
ff5264c
@balasaajay @claude
fix(elastification): align with get_batch + utils refactors (#5194)
adcdf16 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
@Wohox
fix(combined-1f1b): release loss-node input storage after combined ba…
5da641c 
…ckward (#4909)
@github-actions
chore(beep boop 🤖): Bump (main) (2026-06-08)
dbf719b
@dimapihtar
Avoid stat syscall in rerun result validation (#5107)
17a5a80 
Signed-off-by: dimapihtar <dpykhtar@nvidia.com>
@sbhavani
docs: Update Latest News in README.md (#3790)
71e2246
@cspades
Fix bug with Megatron-FSDP zero counter not working with decoupled gr…
3e6e32b 
…adients. (#4802)

Signed-off-by: Cory Ye <cye@nvidia.com>
@balasaajay
ci: add smoke tests (#5143)
1829fd9
balasaajay and others added 30 commits July 14, 2026 16:27
@balasaajay
build: Update Transformer Engine to 2.17 (#5680)
97b25d9 
Signed-off-by: Ajay <abalasa@nvidia.com>
Signed-off-by: Ajay Balasa <abalasa@nvidia.com>
Signed-off-by: [Your Name] <your.email@example.com>
@santhnm2 @claude
Mamba prefix caching fixes (#5502)
e5344ab 
Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
@wujingyue
Exercise nested MFSDP CUDA graph capture (#5796)
a327943 
Signed-off-by: Jingyue Wu <jingyuew@nvidia.com>
@Mellonta
Implement Quantile Balancing in MoE (#5349)
33706f9 
Signed-off-by: Haoran Zhang <haoranz@nvidia.com>
@wujingyue
Unset NCCL overrides for MFSDP v2 tests (#5794)
f8c9911 
Signed-off-by: Jingyue Wu <jingyuew@nvidia.com>
@wujingyue
Fix MegatronFSDP root module hook dispatch (#5808)
4bf7fca 
Signed-off-by: Jingyue Wu <jingyuew@nvidia.com>
@balasaajay
Pin cudnn-fe and cuTeDSL version (#5812)
834abc1 
Signed-off-by: Ajay Balasa <abalasa@nvidia.com>
@github-actions
chore: rotate oncall schedule
5abab93
@sidsingh-nvidia
Inference: Add the nemotron_v3 reasoning parser (#5634)
82e9dc6 
Signed-off-by: Siddharth Singh <sidsingh@nvidia.com>
@jinhangchoi @cspades
Missing moe_router_dtype causes unexpected downcast in ModelOpt examp…
ccdfa7d 
…le (#5810)

Signed-off-by: Jinhang Choi <jinhangc@nvidia.com>
Co-authored-by: Cory Ye <44509866+cspades@users.noreply.github.com>
@wujingyue @svcnvidia-nemo-ci
Avoid FSDP unit terminology in MFSDP v2 (#5793)
5e45ccf 
Signed-off-by: Jingyue Wu <jingyuew@nvidia.com>
Signed-off-by: svcnvidia-nemo-ci <svcnvidia-nemo-ci@nvidia.com>
Co-authored-by: svcnvidia-nemo-ci <svcnvidia-nemo-ci@nvidia.com>
@shanhaoli
Fix configured norm epsilon in MambaLayer (#5750)
7711346 
Signed-off-by: Shanhao <5197744+shanhaoli@users.noreply.github.com>
@Connor-XY @claude
[refactor] Common combined-1F1B schedule-plan base (1/4 of #4798) (#4941
ffbe018 
)

Signed-off-by: Yan Xu <yxu1@nvidia.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
@svcnemo-autobot
chore(tests): AUT-851 move NCCL defaults from run_ci_test.sh to conft…
ecf5547 
…est (#5826)

Signed-off-by: svcnemo-autobot <svcnemo-autobot@nvidia.com>
@santhnm2
Set num_splits to 0 for FA4 inference (#5804)
8bf7365 
Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com>
@balasaajay
ci: Enhance nightly/mr/weekly error reporting (#5831)
06bb399 
Signed-off-by: Ajay Balasa <abalasa@nvidia.com>
@balasaajay
feat(docker): Add NCCL installation script and install NCCL 2.30.4 (#…
3927d9b 
…5815)

Signed-off-by: Ajay Balasa <abalasa@nvidia.com>
@shanmugamr1992
IMA fix by making the copy of book keeping buffer to GPU blocking (#5715
53a2dd5 
)

Signed-off-by: Shanmugam Ramasamy <111910568+shanmugamr1992@users.noreply.github.com>
@Phlip79
Add GPTModel to HybridModel migration guide (#5698)
802da56 
Signed-off-by: Philip Petrakian <ppetrakian@nvidia.com>
@wujingyue
Pair frozen FSDP backward hooks (#5710)
38626c2 
Signed-off-by: Jingyue Wu <jingyuew@nvidia.com>
@wujingyue
Clarify NVIDIA email signing guidance (#5699)
c2f0df5 
Signed-off-by: Jingyue Wu <jingyuew@nvidia.com>
@wujingyue
Overlap FSDP communication with compute (#5719)
d981f66 
Signed-off-by: Jingyue Wu <jingyuew@nvidia.com>
@ko3n1g @claude
chore(skills): add Regent Open Plugin manifest (#5840)
7b2a97b 
Signed-off-by: oliver könig <okoenig@nvidia.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
@ko3n1g
chore(skills): remove Open Plugin manifest (superseded) (#5842)
2aa3645 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@sidsingh-nvidia
return prefix cache hits data from the chat completions api (#5609)
edd4562 
Signed-off-by: Siddharth Singh <sidsingh@nvidia.com>
@santhnm2
Refactor data parallel coordinator to enable modular handlers (#5550)
f8e1ac6 
Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com>
@wujingyue
Pass device IDs to cleanup barrier (#5702)
407ea4f 
Signed-off-by: Jingyue Wu <jingyuew@nvidia.com>
@Marks101
Fix averaging for MoE z-loss metric tracking (#3199)
4abeecc 
Signed-off-by: Markus Schnös <markus.schnoes@deepl.com>
Co-authored-by: Markus Schnös <markus.schnoes@deepl.com>
@svcnemo-autobot
test(mfsdp): AUT-881 mark test_overlaps_communication_and_compute fla…
9a67ea0 
…ky (#5848)

Signed-off-by: svcnemo-autobot <svcnemo-autobot@nvidia.com>
@sidsingh-nvidia
Inference: Extend default cuda-graph coverage to 512 tokens (#5797)
740c16e
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.