Repository navigation

Support learnable softmax (attention sink) with cp_comm_type="p2p" - #3551

Open

0z5a wants to merge 4 commits into

NVIDIA:mainfrom

0z5a:cp-p2p-learnable-softmax

Open

Support learnable softmax (attention sink) with cp_comm_type="p2p"#3551
0z5a wants to merge 4 commits into
NVIDIA:mainfrom
0z5a:cp-p2p-learnable-softmax

Commits on Sep 24, 2026
- Support learnable softmax (attention sink) with cp_comm_type="p2p"
  0z5a
  committed
  649969b
Commits on Oct 27, 2026
- Count the attention sink once per query row in CP p2p
  0z5a
  committed
  462355e
- Test learnable and off-by-one softmax with CP p2p
  0z5a
  committed
  aa5a177
Commits on Oct 28, 2026
- Support FP8 attention with a sink in CP p2p
  0z5a
  committed
  2f77d80