Skip to content

Refresh v5 migration guide performance numbers with a real benchmark run - #159

Merged
stijnvanhulle merged 2 commits into
mainfrom
claude/migration-guide-timing-validation-1dnhvc
Jul 18, 2026
Merged

Refresh v5 migration guide performance numbers with a real benchmark run#159
stijnvanhulle merged 2 commits into
mainfrom
claude/migration-guide-timing-validation-1dnhvc

Conversation

@stijnvanhulle

Copy link
Copy Markdown
Contributor

🎯 Changes

The migration guide's Performance section (docs/5.x/migration.md) had speed numbers with no reproducible source, and no memory data at all. Replaces them with the output of a real run of kubb-labs/kubb#3832's scripts/benchmark/v4-vs-v5 harness against the current v4 (4.39.2) and v5 beta (5.0.0-beta.104):

  • Both time and memory, per spec and plugin combination, instead of time only.
  • A link to the reproducible benchmark script instead of an unsourced claim.
  • The <SpeedComparison /> chart embedded directly in the guide.
  • A short explanation of why v5 memory usage is worse than v4 on the smallest spec (fixed adapter overhead that a 21-operation spec is too small to amortize) but pulls far ahead on larger specs, which the old table didn't cover at all.

Also updates blog/v5.md, whose "up to 6x faster" headline and OpenAI operation count (242) were stale relative to the new run (now "up to 5x", 281 operations, since the OpenAI spec is fetched live and has grown).

✅ Checklist

  • I have followed the steps in the Contributing guide.
  • I am using USA English (serialize, color, center, canceled, analyze, license).
  • I ran the humanizer check on any new documentation I wrote.

Generated by Claude Code

… run

The Performance section carried unsourced numbers with no reproducible
script behind them and no memory data. Replace them with a real run of
kubb-labs/kubb's scripts/benchmark/v4-vs-v5 harness against the current
v4 (4.39.2) and v5 beta (5.0.0-beta.104), covering both time and memory,
and embed the SpeedComparison chart. Update the v5 blog post's numbers
(6x -> 5x, openai spec grew from 242 to 281 operations) to match.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_019xRkYw3bDucJ342j15p9yg
@changeset-bot

changeset-bot Bot commented Jul 18, 2026

Copy link
Copy Markdown

⚠️ No Changeset found

Latest commit: 2687412

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_019xRkYw3bDucJ342j15p9yg
@stijnvanhulle
stijnvanhulle merged commit 512b852 into main Jul 18, 2026
1 check passed
@github-actions
github-actions Bot deleted the claude/migration-guide-timing-validation-1dnhvc branch July 18, 2026 16:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants