feat(moe): layout-API MXFP4 (a4w4/a8w4) MoE gemm#753

Open

coderfeli wants to merge 75 commits into

mainfrom

Commits on Jun 28, 2026

refactor(mxfp4-moe): route a/ascale/output load-store through fx.copy

coderfeli
and
claude
committed
refactor(mxfp4-moe): reuse fp8_gemm_utils for buffer-view/LDS-DMA helpers

coderfeli
and
claude
committed
chore(mxfp4-moe): drop dead code orphaned by the fx.copy migration + format

coderfeli
and
claude
committed
chore(mxfp4-moe): drop redundant .gitignore entry (resolves PR base conflict)

coderfeli
and
claude
committed
refactor(mxfp4-moe): use typed-pointer ptr[i] for scalar loads/stores

coderfeli
and
claude
committed
refactor(mxfp4-moe): typed fx.ptr_load for the remaining LDS vector/scalar reads

coderfeli
and
claude
committed
test(moe): tolerate pytest.skip in the __main__ benchmark runner

coderfeli
and
claude
committed
docs(mxfp4-moe): trim comments/docstrings to <3 lines

coderfeli
and
claude
committed
refactor(mxfp4-moe): strip leading underscores from MoE kernel names

coderfeli
and
claude
committed
refactor(mxfp4-moe): drop redundant fx.Int32/Index wrappers

coderfeli
and
claude
committed
refactor(mxfp4-moe): replace IR-equivalent raw arith with fx operators

coderfeli
and
claude
committed
refactor(mxfp4-moe): port remaining raw arith to fx operators

coderfeli
and
claude
committed
refactor(mxfp4-moe): 1-line comments, dedup run_compiled, typed cumsum load

coderfeli
and
claude
committed
refactor(mxfp4-moe): dissolve kernels/utils.py into moegemm (kernel-specific)

coderfeli
and
claude
committed

Commits on Jun 29, 2026

Commits on Jun 30, 2026

Commits on Jul 1, 2026

Commits on Jul 2, 2026

feat(mxmoe-v2): port N-skip (model_dim output pad-skip) to gemm2

coderfeli
and
claude
committed
feat(mxmoe-v2): 2-stage B-weight software pipeline for gemm2 K-loop

coderfeli
and
claude
committed
perf(mxmoe-v2): opt-in gemm2 B-prefetch-above-barrier hoist (ATT-guided)

Felix Li
and
claude
committed
perf(mxmoe-v2): opt-in gemm2 A-scale prefetch (ISA mem-pattern align vs aiter)

Felix Li
and
claude
committed
perf(mxmoe-v2): opt-in gemm2 spatial tile partitioner (portable channel balance, replaces xcd)

Felix Li
and
claude
committed
perf(mxmoe-v2): make the validated gemm2 opt stack the default + clean up

Felix Li
and
claude
committed

Commits on Jul 3, 2026

refactor(mxmoe-v2): condense comments + trim LOCs (byte-identical ISA)

Felix Li
and
claude
committed
feat(mxmoe-v2): make model_dim/hidden fully runtime (drop from compile keys)

Felix Li
and
claude
committed
perf(mxmoe-v2): fixed-factor unroll runtime-K gemm1 to recover the compile-time schedule

Felix Li
and
claude
committed
style(mxmoe-v2): condense unroll-fix comments to single lines (byte-identical ISA)

Felix Li
and
claude
committed
perf(mxmoe-v2): hoist gemm1 A-gather address divide out of the runtime-K loop

Felix Li
and
claude
committed
perf(mxmoe-v2): drop the fp8-A gemm1 remainder-tail %kAStages slot divide

Felix Li
and
claude
committed
cleanup(mxmoe-v2): second-pass comment/LOC trim on runtime-K gemm code

Felix Li
and
claude
committed