fix open-weights metadata: 29 missing weights links, 3 wrong flags - #3909
Open
arimxyer wants to merge 1 commit into
Open
fix open-weights metadata: 29 missing weights links, 3 wrong flags#3909arimxyer wants to merge 1 commit into
arimxyer wants to merge 1 commit into
Conversation
The repository invariant 'open_weights = true implies weights links' (packages/core/test/generate.test.ts) fails on 32 registry records. Every entry was verified against Hugging Face individually: - 29 records get their canonical Hugging Face repo added as [[weights]] (label/url form used by all 93 existing entries). Non-obvious repo spellings verified live: NVIDIA's underscore variants (Llama-3_1-Nemotron-Ultra-253B-v1), the -HF Transformers conversion for Llama-3.1-Nemotron-70B-Instruct, BF16-suffixed Nemotron 3 repos, and CohereLabs (not cohere) for Command A Plus and North Mini Code. - 3 records had the flag itself wrong and are corrected to open_weights = false, each with a top-of-file citation comment: deepreinforce/ornith-1.0-31b (announced but never published — the org ships only 9B/35B/397B), nvidia/mistral-nemotron (NIM API-only, no public weights), nvidia/nemotron-voicechat (application-only Early Access, not publicly downloadable). bun validate passes; the core suite is fully green after this change (111 pass / 0 fail). Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Contributor
Action items
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
The repository invariant
open_weights = true⇒ weights links (packages/core/test/generate.test.ts, "repository open-weight model metadata includes weights links") currently fails on 32 registry records. Every one was verified against Hugging Face individually — each URL below was fetched and confirmed to be that model's official repo.29 records were genuinely open but missing links — each gets its canonical Hugging Face repo as a
[[weights]]entry (thelabel = "Hugging Face"+urlform used by all 93 existing entries). Non-obvious repo spellings, all verified live:3 records had the flag itself wrong and are corrected to
open_weights = false, each with a top-of-file citation comment (per AGENTS.md comment placement rules):deepreinforce/ornith-1.0-31b— the 31B Dense variant is named in the announcement but was never published: the org ships only 9B/35B/397B, and no 31B repo or community quantization exists anywhere on HFnvidia/mistral-nemotron— no public weights; served API-only via NVIDIA NIM,nvidia/Mistral-Nemotrondoes not exist on HFnvidia/nemotron-voicechat— weights are behind an application-only Early Access Program, not publicly downloadable; no HF repo exists. Worth revisiting if NVIDIA opens general access.Verification
bun validatepasses, and the core test suite goes fully green with this change (111 pass / 0 fail — the weights-link invariant was the only repository-data failure). A follow-up PR proposes running that suite in CI so this class of drift is caught at PR time.🤖 Generated with Claude Code