Skip to content

Pull requests: pytorch/torchtitan

New pull request New
446 Open 3,124 Closed
446 Open 3,124 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[tools] Report paired numerical-diff statistics in loss_compare.py CLA Signed This label is managed by the Meta Open Source bot.
#4393 opened Sep 1, 2026 by yuweih205 Loading…
4 of 5 tasks
2
[do not review] add CP for qwen3.5 gdn CLA Signed This label is managed by the Meta Open Source bot.
#4391 opened Sep 1, 2026 by acisseJZhong Contributor • 2/2 • Draft
align shape suffix between attn and linear attn ciflow/rl CLA Signed This label is managed by the Meta Open Source bot.
#4390 opened Sep 1, 2026 by acisseJZhong Contributor • 1/2 Loading…
9
Replace Qwen3.5 FLA paths with Attention Gym ciflow/rl CLA Signed This label is managed by the Meta Open Source bot.
#4389 opened Sep 1, 2026 by drisspg Contributor • Draft
Fixed spmd typecheck for qwen35 and kimi27 CLA Signed This label is managed by the Meta Open Source bot.
#4388 opened Sep 1, 2026 by jinsooihm Contributor Loading…
1
[muse_glimmer] Enable CP for the multimodal model CLA Signed This label is managed by the Meta Open Source bot.
#4387 opened Aug 31, 2026 by jinsooihm Contributor Loading…
1
Fuse Linear WGRAD accumulation across PP microbatches CLA Signed This label is managed by the Meta Open Source bot.
#4386 opened Aug 31, 2026 by anijain2305 Contributor • Draft
5
[1/2] [GraphTrainer] Support dense FP8 compilation CLA Signed This label is managed by the Meta Open Source bot.
#4384 opened Aug 31, 2026 by WhoisZihan Loading…
1
[DO NOT review, pending K3 text PP merging] [Kimi K3] Add K3 MoonViT DEP support to schedule ViT stages into text LLM PP bubbles CLA Signed This label is managed by the Meta Open Source bot.
#4381 opened Aug 30, 2026 by QIU023 Contributor • Draft
[DO NOT review, pending K3 text CP side merging] [Kimi K3] Add K3 MoonViT Dynamic CP support CLA Signed This label is managed by the Meta Open Source bot.
#4380 opened Aug 30, 2026 by QIU023 Contributor • Draft
Share equivalent RoPE cache storage CLA Signed This label is managed by the Meta Open Source bot.
#4376 opened Aug 29, 2026 by Mystri Contributor • Draft
14
[Kimi K3] allow KDA using inline Attention Gym reference eager implementation to support non-SM100/103 devices CLA Signed This label is managed by the Meta Open Source bot.
#4374 opened Aug 29, 2026 by QIU023 Contributor Loading…
1
[Qwen3.5] Fix MoE expert weight layouts in state dict adapter CLA Signed This label is managed by the Meta Open Source bot.
#4373 opened Aug 29, 2026 by taking-lying-flat Contributor Loading…
[DO NOT REVIEW] Add MXFP8 recipes for the qwen3 and gpt_oss MoE models CLA Signed This label is managed by the Meta Open Source bot.
#4372 opened Aug 28, 2026 by anijain2305 Contributor • 5/5 • Draft
[DO NOT REVIEW] Handle unevenly sharded expert weights in FSDP compute weights CLA Signed This label is managed by the Meta Open Source bot.
#4371 opened Aug 28, 2026 by anijain2305 Contributor • 4/5 • Draft
Pass the expert weight, not its transpose, to the grouped-mm seam CLA Signed This label is managed by the Meta Open Source bot.
#4368 opened Aug 28, 2026 by anijain2305 Contributor • 2/5 Loading…
4
[rl] RendererConfig silently drops the removed preserve_* renderer knobs ciflow/rl CLA Signed This label is managed by the Meta Open Source bot.
#4365 opened Aug 28, 2026 by andylizf Loading…
@felipemello1
7
switch GDN to use attn-gym kernels for titanRL ciflow/rl CLA Signed This label is managed by the Meta Open Source bot.
#4363 opened Aug 28, 2026 by liangel-02 Contributor Loading…
29
[ROCm][CI] Re-enable ROCm CI & make CI changes as per new CI design ciflow/rocm CLA Signed This label is managed by the Meta Open Source bot. module: rocm
#4361 opened Aug 27, 2026 by akashveramd Collaborator • Draft
@akashveramd
3
Enable CudaGraph Annotations CLA Signed This label is managed by the Meta Open Source bot.
#4359 opened Aug 27, 2026 by SherlockNoMad Contributor Loading…
8
[rl] Add optional Verifiers rollout integration ciflow/rl CLA Signed This label is managed by the Meta Open Source bot.
#4356 opened Aug 27, 2026 by wwwjn Contributor • Draft
1
[models] Upgrade Qwen3.5 implementation to Qwen3.8 ciflow/rl CLA Signed This label is managed by the Meta Open Source bot.
#4355 opened Aug 27, 2026 by wwwjn Contributor Loading…
4
[DistMuon] Support tensor-parallel storage layouts CLA Signed This label is managed by the Meta Open Source bot.
#4353 opened Aug 27, 2026 by shuhuayu Contributor • Draft
[WIP] kda in torchtitan (vllm integration) ciflow/rl CLA Signed This label is managed by the Meta Open Source bot.
#4352 opened Aug 27, 2026 by liangel-02 Contributor Loading…
[kimi k3] Support sample packing in KDA CLA Signed This label is managed by the Meta Open Source bot.
#4347 opened Aug 27, 2026 by JavaZeroo Contributor Loading…
1 of 2 tasks
3
ProTip! Filter pull requests by the default branch with base:main.