Benchmark numbers are only useful when you know what job was measured.
A new proof row is about to be published. Before the number goes public, it must name the category, included work, excluded work, and claim-ledger row.Classify
Pick the benchmark category before writing copy.
→
Bound
Name what the measurement includes and what it does not include.
→
Ledger
Put the value, unit, category, mechanism, and non-claims in the claim ledger.
The categories
Why warm local read is allowed to be tiny
Warm means the operating system already has the needed file pages available. Local means the read does not cross a network. Known position means Bitfield is not asking a separate database process to parse, plan, and search for the answer.That does not break physics. It names the physics being measured.Why the non-claims matter
The headline number is never the whole truth. The non-claims tell you where the number stops.If a number says warm local read, do not read it as cold disk, network request, every possible query, or every possible write.
How docs should present numbers
Every public speed row needs:- The number.
- The unit.
- The measured category.
- The mechanism.
- A list of what the number is not claiming.
Measurement envelope
Every public benchmark claim needs this envelope before it appears in a page:Publishability test
Before a number ships, answer these questions in order:- Can a reader tell what job was measured without asking us?
- Can a reader tell which work was excluded?
- Can a skeptical engineer compare it only to the same category?
- Can generated summaries find the claim row and avoid stretching it?
- Can the page explain the public mechanism without exposing private implementation details?