Why this page exists. A dataset whose numbers change silently cannot be cited: a reader has no way to tell whether the figure they quoted last month is the figure the URL serves today. Anything corrected after release is recorded here, the patch version increments, and the old value stays visible so a citation can be traced.
How a correction is handled
- The figure is fixed in data.json and in every representation derived from it. A CI guard fails the change if any of them disagree.
- The patch component of the dataset
versionincrements —2026.06.0becomes2026.06.1. The snapshot period does not change; only the patch does. - An entry is added to the table below and to the changelog, naming the old value, the new value and the evidence.
Corrections cover published figures. Adding a benchmark, or moving the snapshot forward to a new period, is a new minor version and belongs in the changelog rather than here.
Log
| Date | Benchmark | Field | Was | Now | Why | Fixed in |
|---|---|---|---|---|---|---|
No corrections have been issued since versioning began at 2026.06.0 on 2026-08-22. This row is not a claim that the dataset is free of errors — it means none has been found and fixed yet. Entries will appear here as they are. | ||||||
Reporting an error
If a figure here disagrees with its primary source, or a source has been superseded, open an issue at github.com/santismm/benchmarks/issues. The most useful report names the benchmark, the field, the value you expected and a link to the evidence.
Known limitations that are not errors — vendor-reported figures, unstandardised harnesses, missing variance data — are listed on the methodology page instead. They are properties of the dataset, disclosed up front, rather than mistakes awaiting correction.