Benchlog records traceable official disclosures, preserving benchmark versions, model configurations, reported values, and source coverage.
Current coverage and launch records
Current coverage includes reviewed later disclosures and corrections. The launch view uses only materials supported by historical versions. Release dates, score publication dates, disclosure dates, and collection dates are recorded separately. Unknown dates remain unconfirmed.
Configurations, metrics, and condition groups
Scores are read by benchmark version, metric, unit, original protocol, tool access, effective reasoning budget, and framework. Regular rankings follow the configured display tiers and exclusion rules. The latest scope for each series includes all official releases from the same date. Historical records remain available when the latest release has no score. Conflicting and inexact values are provided for reference only.
Unspecified tool access, budgets, and frameworks remain unknown. Even when two records show the same score or group, check the source to confirm the experimental conditions.
Disclosure scope and gaps
“Not found in this release” means the item was not found within the materials reviewed for that release. “Pending review” and “not recorded” preserve gaps in source coverage. A source that discloses only a benchmark name still has an evidence link.
Corrections and citations
Official corrections preserve the previous text, replacement value, and supporting basis. Rankings use the active records in the current materials. Citations retain the model version, configuration, metric, unit, and source location. Evidence pages provide excerpts and selectable citation text. Verified locations link directly to the official section or physical PDF page.