Skip to main content

Benchmark numbers are only useful when you know what job was measured.

A new proof row is about to be published. Before the number goes public, it must name the category, included work, excluded work, and claim-ledger row.
Classify

Pick the benchmark category before writing copy.

Bound

Name what the measurement includes and what it does not include.

Ledger

Put the value, unit, category, mechanism, and non-claims in the claim ledger.

No number should ship as a slogan. It should ship as a bounded claim.The wrong way to read a benchmark is to take one number from one category and compare it to a different number from another category. A warm local read, a cold local read, a content address lookup, a durable batch write, a runtime call, and a network command are different jobs.

The categories

Why warm local read is allowed to be tiny

Warm means the operating system already has the needed file pages available. Local means the read does not cross a network. Known position means Bitfield is not asking a separate database process to parse, plan, and search for the answer.That does not break physics. It names the physics being measured.

Why the non-claims matter

The headline number is never the whole truth. The non-claims tell you where the number stops.
If a number says warm local read, do not read it as cold disk, network request, every possible query, or every possible write.

How docs should present numbers

Every public speed row needs:
  • The number.
  • The unit.
  • The measured category.
  • The mechanism.
  • A list of what the number is not claiming.
That is why the benchmark ledger and claim ledger exist.

Measurement envelope

Every public benchmark claim needs this envelope before it appears in a page:

Publishability test

Before a number ships, answer these questions in order:
  1. Can a reader tell what job was measured without asking us?
  2. Can a reader tell which work was excluded?
  3. Can a skeptical engineer compare it only to the same category?
  4. Can generated summaries find the claim row and avoid stretching it?
  5. Can the page explain the public mechanism without exposing private implementation details?
If any answer is no, the number is not ready for public docs.

Common failures

Next

Read Comparison guardrails, then check the exact rows in the Claim ledger.
Last modified on May 10, 2026