Home Model series Claude Sonnet Claude Sonnet · OfficeQA · Pro 133-question subset · Release history Claude Sonnet · OfficeQA · Pro 133-question subset · Release history View scores, configurations, and disclosures for OfficeQA · Pro 133-question subset across 2 Claude Sonnet releases, ordered by release date.
Differences are calculated only for unique, active, exact values between direct predecessors when the unit, metric, and explicitly recorded configuration and conditions match.
2026-06-30 · 1 score record for this release, including 1 exact value (may include historical records)
Claude Sonnet 5 · OfficeQA scores and configurations Metric and score Configuration and evaluation conditions Sources Exact-match accuracy 59.4% Reported 59.4% · Unit % Published Unconfirmed
Standard configuration: adaptive thinking, max effort Settings Adaptive thinking at max effort; default temperature and top_p; five-trial averages unless otherwise stated. Unknowns Context-window size is evaluation-dependent; standard configuration is 1M tokens. Tools Tools allowed Reasoning budget max Framework not recorded Protocol OfficeQA Pro 133-question subset; exact-match accuracy; five-trial mean. Conditions Agentic evaluation with extracted-text documents and code execution; max effort. View this score in rankings
§8.11.1, PDF p.131 Attachment · Claude Sonnet 5 System Card 2026-09-28 · 1 score record for this release, including 1 exact value (may include historical records)
Records for the direct predecessor do not provide matching conditions for a valid difference.
Claude Sonnet 5.5 · OfficeQA scores and configurations Metric and score Configuration and evaluation conditions Sources Exact-match accuracy 65.6% Reported 65.6% · Unit % Published Unconfirmed
Max effort Settings Max reasoning effort. Unknowns Adaptive thinking status is benchmark-specific. Tools Tool access not recorded Reasoning budget max Framework not recorded Protocol OfficeQA Pro 133-question subset; exact-match accuracy. Conditions Agentic use of preselected extracted-text documents; max effort. View this score in rankings
§8.14.1, PDF p.132 Attachment · Claude Sonnet 5.5 System Card