Skip to content

Pull requests: pytorch/torchtitan

New pull request New
184 Open 1,520 Closed
184 Open 1,520 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[FSDP2] enable per-param mesh FSDP2 for MoE and per-layer compile ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2281 opened Jan 28, 2026 by weifengpy Loading…
[rl] GQA attention fix ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2277 opened Jan 27, 2026 by wwwjn Loading…
1
[DeepEP Integration] Free cache after combine for forward only path. CLA Signed This label is managed by the Meta Open Source bot.
#2274 opened Jan 25, 2026 by elfiegg • Draft
Enable graph_pp for autoparallel in torchtitan ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2271 opened Jan 23, 2026 by sanketpurandare • Draft
Fix grad norm clipping for AutoP and dsv3 model init ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2270 opened Jan 22, 2026 by sanketpurandare Loading…
3
[mxfp8 moe training] temp workaround: don't compile GroupedExperts ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2268 opened Jan 21, 2026 by danielvegamyhre Loading…
5
[NOT_FOR_LAND] inductor auto_bucketing passes benchmarking for DSv3 ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2266 opened Jan 21, 2026 by IvanKobzarev Loading…
[LoRA] Add LoRA converter for LoRA finetuning ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2263 opened Jan 20, 2026 by mori360 Loading…
34
Remove unnecessary token padding for MoE in BF16 mode CLA Signed This label is managed by the Meta Open Source bot.
#2255 opened Jan 20, 2026 by rakkit Loading…
9
[mxfp8 training] add new configurable params now exposed by torchao ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2251 opened Jan 18, 2026 by danielvegamyhre Loading…
7
[mxfp8 moe training] mxfp8 all to all ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2250 opened Jan 17, 2026 by danielvegamyhre Loading…
11
[mxfp8 moe training] support wgrad_with_hp recipe ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2249 opened Jan 17, 2026 by danielvegamyhre Loading…
2
Add ROCm CI support for Auto Parallel & Compiler Toolkit experiments ciflow/rocm-mi300 ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot. module: rocm
#2248 opened Jan 17, 2026 by akashveramd • Draft
@akashveramd
1
[rl] refactor grader and trainer generator actor ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2244 opened Jan 16, 2026 by wwwjn Loading…
13
[lint] ignore all existing pyrefly errors (v0.45.1) ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2241 opened Jan 16, 2026 by xmfan Loading…
[DONT LAND] Implement PrefetchedDataloader for overlapped data loading ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2232 opened Jan 14, 2026 by fegin Loading…
12
[rl] refactor save and load model weights using DCP ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2221 opened Jan 13, 2026 by wwwjn Loading…
5
feat(gpt-oss): add YaRN RoPE extensions with mscale for extended context CLA Signed This label is managed by the Meta Open Source bot.
#2216 opened Jan 8, 2026 by eous Loading…
13
feat(training): add freeze_router_bias and freeze_expert_bias configs… CLA Signed This label is managed by the Meta Open Source bot.
#2215 opened Jan 8, 2026 by eous Loading…
3
fix: enable torch.autocast for TP parallelism without FSDP CLA Signed This label is managed by the Meta Open Source bot.
#2213 opened Jan 8, 2026 by eous Loading…
5
feat(moe): add topk_before_score routing and use_router_bias support CLA Signed This label is managed by the Meta Open Source bot.
#2212 opened Jan 8, 2026 by eous Loading…
@shuhuayu
27
fix(gpt-oss): correct attention sink from sigmoid to LSE renormalization CLA Signed This label is managed by the Meta Open Source bot.
#2211 opened Jan 8, 2026 by eous Loading…
@wwwjn
4
feat: add differential learning rate and weight decay support CLA Signed This label is managed by the Meta Open Source bot.
#2210 opened Jan 8, 2026 by eous Loading…
13
[HybridEP] Support hybridEP for GB200 with NVL72 CLA Signed This label is managed by the Meta Open Source bot.
#2207 opened Jan 8, 2026 by elfiegg Loading…
@shuhuayu
16
feat(gpt-oss): Add CPU offload optimizer, differential LR/WD, and more CLA Signed This label is managed by the Meta Open Source bot.
#2205 opened Jan 7, 2026 by eous Loading…
31
ProTip! Add no:assignee to see everything that’s not assigned.