Skip to content

fix(megatron): shard Megatron rollouts across DP coordinator leaders - #3571

Closed
YigongQin wants to merge 1 commit into
NVIDIA-NeMo:mainfrom
YigongQin:yigongq/m-infdp
Closed

YigongQin wants to merge 1 commit into
NVIDIA-NeMo:mainfrom
YigongQin:yigongq/m-infdp

Commits

  1. Commits on Aug 9, 2026