Skip to content

Enable FSDP2 + expert parallelism via a 2-D (fsdp, tp) device mesh - #48516

Open
qgallouedec wants to merge 8 commits into
fix-ep-training-gradientsfrom
fsdp2-ep-2d-mesh
Open

Enable FSDP2 + expert parallelism via a 2-D (fsdp, tp) device mesh#48516
qgallouedec wants to merge 8 commits into
fix-ep-training-gradientsfrom
fsdp2-ep-2d-mesh

Cosmetic: docstring layout, comment placement, doc link

393af53
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar