Skip to content

Add an FSDP2-native Ulysses sequence parallelism backend - #4209

Open
qgallouedec wants to merge 14 commits into
mainfrom
ulysses-torch-backend
Open

Add an FSDP2-native Ulysses sequence parallelism backend#4209
qgallouedec wants to merge 14 commits into
mainfrom
ulysses-torch-backend

Merge branch 'main' into ulysses-torch-backend

b17471b
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar