Skip to content

Support learnable softmax (attention sink) with cp_comm_type="p2p" - #3551

Open
0z5a wants to merge 4 commits into
NVIDIA:mainfrom
0z5a:cp-p2p-learnable-softmax
Open

Support learnable softmax (attention sink) with cp_comm_type="p2p"#3551
0z5a wants to merge 4 commits into
NVIDIA:mainfrom
0z5a:cp-p2p-learnable-softmax

Support FP8 attention with a sink in CP p2p

2f77d80
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Oct 28, 2026 in 1s

DCO

All commits are signed off!

View more details on DCO