Track upstream torchtitan changes up to 20260713 - #35

Merged

hann-wang merged 22 commits into

mainfrom

han/torchtitan-20260713

Aug 17, 2026

Commits on Jul 14, 2026

feat: adapt torchtitan dev 20260713
hann-wang
committed
9f19b2c
fix: apply_rotary_emb_complex patch
hann-wang
committed
3a46ed3
fix: token dispatcher with paded tokens;
hann-wang
committed
b9786c9

Commits on Jul 15, 2026

feat: basic DTensor support in wanda
hann-wang
committed
a9efbdb
fix: restore from_linear() classmethod and update test constructor usage
Copilot
authored
ff64beb

Commits on Jul 17, 2026

Commits on Jul 20, 2026

fix: checkpoint manager failed to access untyped storage if tensor wrapper applied
hann-wang
committed
536c13d
Potential fix for pull request finding

hann-wang
and
Copilot
authored
db5fcf3
Potential fix for pull request finding

hann-wang
and
Copilot
authored
dfc194a

Commits on Jul 24, 2026

fx: missing trainer for de-osc
hann-wang
committed
24ed297

Commits on Jul 27, 2026

[WIP] feat: madam optimizer
hann-wang
committed
5e20087

Commits on Jul 28, 2026

test: decompsoed linear with svd init
hann-wang
committed
ec147ef

Commits on Aug 4, 2026

feat: universal optimal scaling (uos) for mxfp4
hann-wang
committed
046589e
fix: _quantize_then_mxfp_scaled_grouped_mm with uos
hann-wang
committed
5bb9208

Commits on Aug 7, 2026

fix: de-osc with uos
hann-wang
committed
29aab52

Commits on Aug 10, 2026

feat: pre-split microbatches
hann-wang
committed
88b7d5a

Commits on Aug 11, 2026

fix: token dispatcher swap
hann-wang
committed
e9d3f5a

Commits on Aug 12, 2026

fix: missing loop index
hann-wang
committed
04e87d7

Commits on Aug 17, 2026

Merge branch 'main' into han/torchtitan-20260713
hann-wang
committed
7d88e38