Skip to content

fix open-weights metadata: 29 missing weights links, 3 wrong flags - #3909

Open
arimxyer wants to merge 1 commit into
anomalyco:devfrom
arimxyer:fix-open-weights
Open

fix open-weights metadata: 29 missing weights links, 3 wrong flags#3909
arimxyer wants to merge 1 commit into
anomalyco:devfrom
arimxyer:fix-open-weights

Conversation

@arimxyer

Copy link
Copy Markdown

What

The repository invariant open_weights = true ⇒ weights links (packages/core/test/generate.test.ts, "repository open-weight model metadata includes weights links") currently fails on 32 registry records. Every one was verified against Hugging Face individually — each URL below was fetched and confirmed to be that model's official repo.

29 records were genuinely open but missing links — each gets its canonical Hugging Face repo as a [[weights]] entry (the label = "Hugging Face" + url form used by all 93 existing entries). Non-obvious repo spellings, all verified live:

3 records had the flag itself wrong and are corrected to open_weights = false, each with a top-of-file citation comment (per AGENTS.md comment placement rules):

  • deepreinforce/ornith-1.0-31b — the 31B Dense variant is named in the announcement but was never published: the org ships only 9B/35B/397B, and no 31B repo or community quantization exists anywhere on HF
  • nvidia/mistral-nemotron — no public weights; served API-only via NVIDIA NIM, nvidia/Mistral-Nemotron does not exist on HF
  • nvidia/nemotron-voicechat — weights are behind an application-only Early Access Program, not publicly downloadable; no HF repo exists. Worth revisiting if NVIDIA opens general access.

Verification

bun validate passes, and the core test suite goes fully green with this change (111 pass / 0 fail — the weights-link invariant was the only repository-data failure). A follow-up PR proposes running that suite in CI so this class of drift is caught at PR time.

🤖 Generated with Claude Code

The repository invariant 'open_weights = true implies weights links'
(packages/core/test/generate.test.ts) fails on 32 registry records.
Every entry was verified against Hugging Face individually:

- 29 records get their canonical Hugging Face repo added as
  [[weights]] (label/url form used by all 93 existing entries).
  Non-obvious repo spellings verified live: NVIDIA's underscore
  variants (Llama-3_1-Nemotron-Ultra-253B-v1), the -HF Transformers
  conversion for Llama-3.1-Nemotron-70B-Instruct, BF16-suffixed
  Nemotron 3 repos, and CohereLabs (not cohere) for Command A Plus
  and North Mini Code.
- 3 records had the flag itself wrong and are corrected to
  open_weights = false, each with a top-of-file citation comment:
  deepreinforce/ornith-1.0-31b (announced but never published — the
  org ships only 9B/35B/397B), nvidia/mistral-nemotron (NIM
  API-only, no public weights), nvidia/nemotron-voicechat
  (application-only Early Access, not publicly downloadable).

bun validate passes; the core suite is fully green after this change
(111 pass / 0 fail).

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@github-actions

Copy link
Copy Markdown
Contributor

Action items

  • [high] [violation] models/nvidia/mistral-nemotron.toml:13 - Check: Provider models that set open_weights must stay consistent with the corrected base metadata (primitives replace on merge). Why: This PR sets open_weights = false on models/nvidia/mistral-nemotron and models/nvidia/nemotron-voicechat, but the NVIDIA provider entries still hardcode open_weights = true (providers/nvidia/models/mistralai/mistral-nemotron.toml:9, providers/nvidia/models/nvidia/nemotron-voicechat.toml:9). Those overrides win the merge, so the published provider catalog keeps advertising non-downloadable models as open-weight. Action: Set both provider files to open_weights = false, or drop the field so they inherit the base value.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant