Skip to content

paro: fix seeding and cleanup#2609

Merged
Qubitium merged 7 commits intomainfrom
paro-seed-static
Mar 25, 2026
Merged

paro: fix seeding and cleanup#2609
Qubitium merged 7 commits intomainfrom
paro-seed-static

Conversation

@Qubitium
Copy link
Collaborator

@Qubitium Qubitium commented Mar 25, 2026 •
edited
Loading

@zhijian-liu @liang2kl

| Metric                                       |   PAROQUANT |
|----------------------------------------------|-------------|
| arc_challenge :: accuracy,loglikelihood      |      0.3516 |
| arc_challenge :: accuracy,loglikelihood_norm |      0.3359 |
| gsm8k_platinum_cot :: acc,num                |      0.4219 |
| mmlu_stem :: acc,ll                          |      0.2969 |
| mmlu_stem :: acc,ll_avg                      |      0.2969 |

big boost in scores after syncing seeding with official implementation, or maybe just got a lucky seed.

@Qubitium Qubitium marked this pull request as draft March 25, 2026 16:59
@Qubitium Qubitium changed the title paro: fix buffer reuse by making the seed sticky fo paro: cleanup Mar 25, 2026
@Qubitium Qubitium changed the title paro: cleanup paro: fix seeding and cleanup Mar 25, 2026
@Qubitium Qubitium marked this pull request as ready for review March 25, 2026 20:22
@Qubitium Qubitium merged commit 403e768 into main Mar 25, 2026
6 checks passed
@Qubitium Qubitium deleted the paro-seed-static branch March 25, 2026 20:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@Qubitium