[WIP][FSDP2] enable per-param mesh FSDP2 for MoE and per-layer compile#2281

weifengpy wants to merge 2 commits intopytorch:mainpytorch/torchtitan:mainfrom

weifengpy:per-param-meshweifengpy/torchtitan:per-param-meshCopy head branch name to clipboard