Skip to content

Gamma ensemble benchmarking scripts - #766

Open
eliotheinrich wants to merge 6 commits into
NVIDIA:mainfrom
eliotheinrich:pr-gamma-ensemble-scripts
Open

Gamma ensemble benchmarking scripts#766
eliotheinrich wants to merge 6 commits into
NVIDIA:mainfrom
eliotheinrich:pr-gamma-ensemble-scripts

Conversation

@eliotheinrich

Copy link
Copy Markdown
Collaborator

Description

This PR adds the standalone scripts used for benchmarking the Relay BP gamma ensemble feature. The docs were introduced in #755. Closes #758.

The BB memory circuit .stim circuits are stored in the repo as LFS objects, avoiding a ~100k line diff.

eliotheinrich and others added 4 commits August 4, 2026 14:11
Signed-off-by: Eliot Heinrich <eheinrich@nvidia.com>
Signed-off-by: Eliot Heinrich <eheinrich@nvidia.com>
Signed-off-by: Eliot Heinrich <eheinrich@nvidia.com>
@eliotheinrich
eliotheinrich marked this pull request as ready for review August 4, 2026 22:22

@melody-ren melody-ren left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @eliotheinrich ! Just my two cents

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It seems like these stim files are byte identical to the original except that DETECTOR lines are removed. If that's the case, could you please use a script to download and strip the stim files with pinned SHA from the source, instead of committing them into LFS?

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The goal was to remove the explicit external dependency for the benchmark, but I'm happy to do it this way as well. @bmhowe23 maybe you can weigh in?

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That's a good point I haven't thought of. Is removing external dependency something we want to achieve in general?

Comment thread benchmarks/qec/relaybp_gamma_ensemble/run_sweep.py
Comment thread benchmarks/qec/relaybp_gamma_ensemble/README.md Outdated
@eliotheinrich
eliotheinrich force-pushed the pr-gamma-ensemble-scripts branch from d4b7f9a to 417d56b Compare August 5, 2026 14:11
Signed-off-by: Eliot Heinrich <eheinrich@nvidia.com>
@eliotheinrich
eliotheinrich force-pushed the pr-gamma-ensemble-scripts branch from 417d56b to 51a5bcd Compare August 5, 2026 14:14
Signed-off-by: Eliot Heinrich <eheinrich@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Upload benchmarking scripts for gamma ensemble docs

2 participants