Home Model series Claude Sonnet Claude Sonnet 5 Claude Sonnet 5 · CharXiv Reasoning · Validation split · Scores and configurations Claude Sonnet 5 · CharXiv Reasoning · Validation split · Scores and configurations Claude Sonnet 5 record for CharXiv Reasoning · Validation split. 2 score records for this release, including 2 exact values (may include historical records). Includes 1 source location.
Scores and evaluation conditions Claude Sonnet 5 · CharXiv Reasoning scores and configurations Metric and score Configuration and evaluation conditions Sources Accuracy 77% Reported 77.0% · Unit % Published Unconfirmed
Adaptive thinking, max effort, no tools Settings Adaptive thinking at max effort; no tools. Unknowns none recorded Tools Tools forbidden Reasoning budget max Framework not recorded Protocol CharXiv Reasoning, 1,000 validation questions; five-run average. Tools: none. Conditions No tools; adaptive thinking and max effort; Sonnet 4.6 grader. View this score in rankings Accuracy 88.3% Reported 88.3% · Unit % Published Unconfirmed
Adaptive thinking, max effort, tools enabled Settings Adaptive thinking at max effort; tools enabled as specified per benchmark. Unknowns none recorded Tools Tools allowed Reasoning budget max Framework not recorded Protocol CharXiv Reasoning, 1,000 validation questions; five-run average. Tools: Python and image cropping. Conditions Python tools and image-cropping available; adaptive thinking and max effort; Sonnet 4.6 grader. View this score in rankings
Benchmark versions and metrics Aliases CharXiv Reasoning
Accuracy · % · Higher is better