Skip to content

[mxfp8] Handle unevenly sharded expert weights in FSDP compute weights - #4371

Open
anijain2305 wants to merge 1 commit into
mxfp8-trainingfrom
mxfp8-uneven-shard-padding
Open

[mxfp8] Handle unevenly sharded expert weights in FSDP compute weights#4371
anijain2305 wants to merge 1 commit into
mxfp8-trainingfrom
mxfp8-uneven-shard-padding

Pad unevenly sharded parameters in the FSDP unshard hooks

76844ac
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar