Skip to content

PEFT x Dtensor-based TP integration - #48485

Open
michaelbenayoun wants to merge 4 commits into
huggingface:mainfrom
michaelbenayoun:peft_tp_sync
Open

PEFT x Dtensor-based TP integration#48485
michaelbenayoun wants to merge 4 commits into
huggingface:mainfrom
michaelbenayoun:peft_tp_sync

Conversation

@michaelbenayoun

@michaelbenayoun michaelbenayoun commented Sep 2, 2026

Copy link
Copy Markdown
Member

CPU CI GPU run-slow

What does this PR do?

The PEFT integration was no up-to-date.
Working on support for the new DTensor-based API in the PEFT repo: huggingface/peft#3614.

cc @BenjaminBossan @3outeille

@michaelbenayoun michaelbenayoun changed the title TP PEFT x Dtensor-based TP integration Sep 2, 2026
@HuggingFaceDocBuilderDev

Copy link
Copy Markdown

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@BenjaminBossan

Copy link
Copy Markdown
Member

IIUC, we should wait for huggingface/peft#3614 to be merged and then check that the PEFT integration in Transformers works with this PR before merging, right?

@michaelbenayoun

Copy link
Copy Markdown
Member Author

@BenjaminBossan yes works for me to do it the suggested order.

@github-actions

github-actions Bot commented Sep 2, 2026

Copy link
Copy Markdown
Contributor

CI recap

Dashboard: View test results in Grafana
Latest run: 33621513291:1
Result: failure | Jobs: 16 | Tests: 185,740 | Failures: 1 | Duration: 16h 24m

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants