Home Model series Claude Sonnet Claude Sonnet 5.5 Claude Sonnet 5.5 · Toolathlon-Verified · June 2026 finalized release · Scores and configurations Claude Sonnet 5.5 · Toolathlon-Verified · June 2026 finalized release · Scores and configurations Claude Sonnet 5.5 record for Toolathlon-Verified · June 2026 finalized release. 4 score records for this release, including 4 exact values (may include historical records). Includes 1 source location.
Scores and evaluation conditions Claude Sonnet 5.5 · Toolathlon-Verified scores and configurations Metric and score Configuration and evaluation conditions Sources Pass@1 77.8% Reported 77.8% · Unit % Published Unconfirmed
Adaptive thinking, max effort Settings Adaptive thinking enabled; max effort. Unknowns Sampling settings may vary by benchmark; see each result.conditions. Tools Tool access not recorded Reasoning budget max Framework not recorded Protocol Toolathlon-Verified June 2026 final release, 108 tasks, three trials. Conditions Adaptive thinking, max effort, safety classifiers enabled; 2 of 324 trials were stopped and counted as failures. View this score in rankings Pass@3 85.2% Reported 85.2% · Unit % Published Unconfirmed
Adaptive thinking, max effort Settings Adaptive thinking enabled; max effort. Unknowns Sampling settings may vary by benchmark; see each result.conditions. Tools Tool access not recorded Reasoning budget max Framework not recorded Protocol Toolathlon-Verified, at least one correct run across three trials on 108 tasks. Conditions Adaptive thinking, max effort, safety classifiers enabled. View this score in rankings Pass³ 68.5% Reported 68.5% · Unit % Published Unconfirmed
Adaptive thinking, max effort Settings Adaptive thinking enabled; max effort. Unknowns Sampling settings may vary by benchmark; see each result.conditions. Tools Tool access not recorded Reasoning budget max Framework not recorded Protocol Toolathlon-Verified, all three runs correct on a task. Conditions Adaptive thinking, max effort, safety classifiers enabled. View this score in rankings Average assistant turns 31.6 turns Reported 31.6 · Unit turns Published Unconfirmed
Adaptive thinking, max effort Settings Adaptive thinking enabled; max effort. Unknowns Sampling settings may vary by benchmark; see each result.conditions. Tools Tool access not recorded Reasoning budget max Framework not recorded Protocol Average assistant turns per Toolathlon-Verified trajectory. Conditions Adaptive thinking, max effort, safety classifiers enabled. View this score in rankings
Benchmark versions and metrics Aliases Toolathlon-Verified
Pass@1 · % · Higher is better Pass@3 · % · Higher is better Pass³ · % · Higher is better Average assistant turns · turns · Lower is better