Skip to content

Fix params_with_grad in FSDP when the model has frozen parameters - #1167

Open
whbldhwj wants to merge 1 commit into
ngoyal_changes_for_pp_fp8_akadianfrom
ngoyal_changes_for_pp_fp8_akadian_jie_fix
Open

Fix params_with_grad in FSDP when the model has frozen parameters#1167
whbldhwj wants to merge 1 commit into
ngoyal_changes_for_pp_fp8_akadianfrom
ngoyal_changes_for_pp_fp8_akadian_jie_fix

Commits

Commits on Mar 4, 2024