Home Model series Claude Opus Claude Opus 4.8 Claude Opus 4.8 · Toolathlon · June 2026 release used in selected source · Scores and configurations Claude Opus 4.8 · Toolathlon · June 2026 release used in selected source · Scores and configurations Claude Opus 4.8 record for Toolathlon · June 2026 release used in selected source. 4 score records for this release, including 4 exact values (may include historical records). Includes 4 source locations.
Scores and evaluation conditions Claude Opus 4.8 · Toolathlon scores and configurations Metric and score Configuration and evaluation conditions Sources Pass@1 59.9% Reported 59.9% · Unit % Published Unconfirmed
Toolathlon 内部 harness Settings Adaptive thinking/max effort;108 tasks,依论文协议 3 trials;内部 harness 固定金融 feed 与容器镜像,约四分之一按原样保留不可满足任务,因此不可与上游绝对值混比。 Unknowns none recorded Tools Tool access not recorded Reasoning budget max Framework not recorded Protocol Toolathlon, 108 tasks; Pass@1 averaged over 3 trials. Conditions Internal harness; adaptive thinking/max effort; task definitions, prompts and checkers mirror upstream; data feeds/containers pinned; roughly a quarter unsatisfiable tasks left unchanged. View this score in rankings Pass@3 67.6% Reported 67.6% · Unit % Published Unconfirmed
Toolathlon 内部 harness Settings Adaptive thinking/max effort;108 tasks,依论文协议 3 trials;内部 harness 固定金融 feed 与容器镜像,约四分之一按原样保留不可满足任务,因此不可与上游绝对值混比。 Unknowns none recorded Tools Tool access not recorded Reasoning budget max Framework not recorded Protocol Toolathlon, Pass@3 across 108 tasks and 3 trials per task. Conditions Internal harness; adaptive thinking/max effort; pinned feeds/containers; roughly a quarter unsatisfiable tasks left unchanged. View this score in rankings Pass³ 48.1% Reported 48.1% · Unit % Published Unconfirmed
Toolathlon 内部 harness Settings Adaptive thinking/max effort;108 tasks,依论文协议 3 trials;内部 harness 固定金融 feed 与容器镜像,约四分之一按原样保留不可满足任务,因此不可与上游绝对值混比。 Unknowns none recorded Tools Tool access not recorded Reasoning budget max Framework not recorded Protocol Toolathlon, Pass³ across 108 tasks and 3 trials per task. Conditions Internal harness; adaptive thinking/max effort; pinned feeds/containers; roughly a quarter unsatisfiable tasks left unchanged. View this score in rankings Average assistant turns 24.5 turns Reported 24.5 · Unit turns Published Unconfirmed
Toolathlon 内部 harness Settings Adaptive thinking/max effort;108 tasks,依论文协议 3 trials;内部 harness 固定金融 feed 与容器镜像,约四分之一按原样保留不可满足任务,因此不可与上游绝对值混比。 Unknowns none recorded Tools Tool access not recorded Reasoning budget max Framework not recorded Protocol Toolathlon average assistant turns across 108 tasks. Conditions Internal harness; adaptive thinking/max effort; pinned feeds/containers. View this score in rankings
Benchmark versions and metrics Aliases Toolathlon
Pass@1 · % · Higher is better Pass@3 · % · Higher is better Pass³ · % · Higher is better Average assistant turns · turns · Lower is better