Skip to content

docs(readme): refresh the benchmark table — accumulated drift (stale numbers + descriptions) found during #440 #442

Description

@pekkah

While updating three rows for #440 I found the README benchmark table has drifted beyond just those rows — both numbers and prose descriptions are stale in places. A full warm re-bench would refresh the whole table.

Evidence of drift (found during #440)

The other rows (full-GPU, op-offload MoE, CPU-only, Vulkan) weren't affected by #440 and were left as-is, but they date from earlier sessions and predate later perf work — so some have likely drifted too (numbers and/or notes).

Proposed

Run the full warm sweep and reconcile every row:

pwsh scripts/bench-allrows-1k.ps1 -CudaOnly           # warm ~2K-ctx prefill
pwsh scripts/bench-allrows-1k.ps1 -CudaOnly -NearZero # near-zero-ctx decode

on the reference machine (Zen 4 12c/24t + RTX 4070 Ti), then update the table numbers and audit the per-row notes for stale claims (like the SLRU one). Same-thermal, interleaved, per the #410 protocol.

Scope note: this is the sharpi-side number refresh; the llama.cpp gap tracking lives in #405. Related: #440 (the fix that surfaced this), #405.

🤖 Generated with Claude Code

Metadata

Metadata

Assignees

No one assigned

    Labels

    maintenanceRecurring upkeep / sync with upstream

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions