[DO NOT REVIEW] Handle unevenly sharded expert weights in FSDP compute weights - #4371

[DO NOT REVIEW] Handle unevenly sharded expert weights in FSDP compute weights#4371

anijain2305 wants to merge 1 commit into

mxfp8-grouped-expertspytorch/torchtitan:mxfp8-grouped-expertsfrom

mxfp8-uneven-shard-paddingpytorch/torchtitan:mxfp8-uneven-shard-paddingCopy head branch name to clipboard