Skip to content

Small helper to run experiments on HF jobs - #3666

Merged
githubnemo merged 4 commits into
huggingface:mainfrom
githubnemo:feature/metamathqa-jobs-script
Sep 18, 2026
Merged

githubnemo merged 4 commits into
huggingface:mainfrom
githubnemo:feature/metamathqa-jobs-script

Conversation

@githubnemo

Copy link
Copy Markdown
Collaborator

This is very much experimental as I was just stringing together a script that covers the use-cases I needed and I only tested the cloning use-case properly. There are probably a few edge-cases here but this is probably better than having nothing and to re-invent the wheel every time (e.g., for agents).

We can possibly iterate on this once we know where most of the friction is.

This is very much experimental as I was just stringing together a
script that covers the use-cases I needed and I only tested the cloning
use-case properly. There are probably a few edge-cases here but this
is probably better than having nothing and to re-invent the wheel
every time (e.g., for agents).

We can possibly iterate on this once we know where most of the
friction is.
@HuggingFaceDocBuilderDev

Copy link
Copy Markdown

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@BenjaminBossan BenjaminBossan left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for adding, LGTM.

@githubnemo

Copy link
Copy Markdown
Collaborator Author

Thanks for the approval. I found a small nit when I was looking at the diff and I think this is worthwhile to fix now. Please do a quick re-review. Thanks :)

@BenjaminBossan BenjaminBossan left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The change makes sense, LGTM.

image="huggingface/peft-gpu:latest",
command=["bash", "-c", cmd],
flavor=args.flavor,
timeout=7200,

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Would it make sense to make this an argument?

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Added as a flag, will merge once you give a ping

@BenjaminBossan BenjaminBossan left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for adding that arg, LGTM.

@githubnemo
githubnemo merged commit fc37692 into huggingface:main Sep 18, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants