Skip to content

[DistMuon] Support tensor-parallel storage layouts - #4353

Draft
shuhuayu wants to merge 2 commits into
pytorch:mainfrom
shuhuayu:flexmuontp
Draft

[DistMuon] Support tensor-parallel storage layouts#4353
shuhuayu wants to merge 2 commits into
pytorch:mainfrom
shuhuayu:flexmuontp

[qk_clip] Support tensor-parallel head scaling

196fff9
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
lint (3.11)
succeeded Aug 27, 2026 in 3m 19s