Claude Sonnet 5 · Toolathlon(June 2026 release used in selected source) · 附件证据(ev5-toolathlon)
Claude Sonnet 5 的 Toolathlon · June 2026 release used in selected source 官方出处。见《Claude Sonnet 5 System Card》§8.11.5 Table 8.11.5.A, PDF pp.134-135。证据 ev5-toolathlon。
Claude Sonnet 5 · Toolathlon(June 2026 release used in selected source),Standard configuration: adaptive thinking, max effort配置,Pass@1 54.3%(具体成绩公布时间未确认)。见《Claude Sonnet 5 System Card》§8.11.5 Table 8.11.5.A, PDF pp.134-135。 查看成绩条件
Claude Sonnet 5 · Toolathlon(June 2026 release used in selected source),Standard configuration: adaptive thinking, max effort配置,Pass@3 63%(具体成绩公布时间未确认)。见《Claude Sonnet 5 System Card》§8.11.5 Table 8.11.5.A, PDF pp.134-135。 查看成绩条件
Claude Sonnet 5 · Toolathlon(June 2026 release used in selected source),Standard configuration: adaptive thinking, max effort配置,Pass³ 40.7%(具体成绩公布时间未确认)。见《Claude Sonnet 5 System Card》§8.11.5 Table 8.11.5.A, PDF pp.134-135。 查看成绩条件
Claude Sonnet 5 · Toolathlon(June 2026 release used in selected source),Standard configuration: adaptive thinking, max effort配置,Average assistant turns 26 turns(具体成绩公布时间未确认)。见《Claude Sonnet 5 System Card》§8.11.5 Table 8.11.5.A, PDF pp.134-135。 查看成绩条件
[Table 8.11.5.A] Model | Pass@1 | Pass@3 | Pass3 | Avg turns; Claude Sonnet 5 | 54.3 | 63.0 | 40.7 | 26.0. Toolathlon scores using an internal harness.
Claude Sonnet 5 · Toolathlon (June 2026 release used in selected source) · Attachment evidence (ev5-toolathlon)
Official source for Toolathlon · June 2026 release used in selected source in Claude Sonnet 5. See “Claude Sonnet 5 System Card” at §8.11.5 Table 8.11.5.A, PDF pp.134-135. Evidence ev5-toolathlon.
Claude Sonnet 5 · Toolathlon (June 2026 release used in selected source), configuration Standard configuration: adaptive thinking, max effort, Pass@1 54.3% (exact score publication date unconfirmed). See “Claude Sonnet 5 System Card” at §8.11.5 Table 8.11.5.A, PDF pp.134-135. View score conditions
Claude Sonnet 5 · Toolathlon (June 2026 release used in selected source), configuration Standard configuration: adaptive thinking, max effort, Pass@3 63% (exact score publication date unconfirmed). See “Claude Sonnet 5 System Card” at §8.11.5 Table 8.11.5.A, PDF pp.134-135. View score conditions
Claude Sonnet 5 · Toolathlon (June 2026 release used in selected source), configuration Standard configuration: adaptive thinking, max effort, Pass³ 40.7% (exact score publication date unconfirmed). See “Claude Sonnet 5 System Card” at §8.11.5 Table 8.11.5.A, PDF pp.134-135. View score conditions
Claude Sonnet 5 · Toolathlon (June 2026 release used in selected source), configuration Standard configuration: adaptive thinking, max effort, Average assistant turns 26 turns (exact score publication date unconfirmed). See “Claude Sonnet 5 System Card” at §8.11.5 Table 8.11.5.A, PDF pp.134-135. View score conditions
[Table 8.11.5.A] Model | Pass@1 | Pass@3 | Pass3 | Avg turns; Claude Sonnet 5 | 54.3 | 63.0 | 40.7 | 26.0. Toolathlon scores using an internal harness.
Attachment · §8.11.5 Table 8.11.5.A, PDF pp.134-135
Material version
PDF with changelog dated 2026-07-10; 146 pages; collected 2026-11-10
Version published
Unconfirmed
Disclosure date
Unconfirmed · Launch or later disclosure unconfirmed
Collected
Historical basis
No reliable historical version evidence available
Citation text
Claude Sonnet 5 · Toolathlon (June 2026 release used in selected source), configuration Standard configuration: adaptive thinking, max effort, Pass@1 54.3% (exact score publication date unconfirmed); Claude Sonnet 5 · Toolathlon (June 2026 release used in selected source), configuration Standard configuration: adaptive thinking, max effort, Pass@3 63% (exact score publication date unconfirmed); Claude Sonnet 5 · Toolathlon (June 2026 release used in selected source), configuration Standard configuration: adaptive thinking, max effort, Pass³ 40.7% (exact score publication date unconfirmed); Claude Sonnet 5 · Toolathlon (June 2026 release used in selected source), configuration Standard configuration: adaptive thinking, max effort, Average assistant turns 26 turns (exact score publication date unconfirmed). Official source: Claude Sonnet 5 System Card (Attachment, PDF with changelog dated 2026-07-10; 146 pages; collected 2026-11-10), §8.11.5 Table 8.11.5.A, PDF pp.134-135, https://www.anthropic.com/claude-sonnet-5-system-card#page=135. Benchlog https://benchlog.lekshome.cc/evidence/claude-sonnet-5/ev5-toolathlon/?lang=en
Related scores and conditions
Claude Sonnet 5 · Toolathlon scores and configurations
Metric and score
Configuration and evaluation conditions
Evidence relation
Pass@154.3%Reported 54.3% · Unit %
Published Unconfirmed
Standard configuration: adaptive thinking, max effort
Settings
Adaptive thinking at max effort; default temperature and top_p; five-trial averages unless otherwise stated.
Unknowns
Context-window size is evaluation-dependent; standard configuration is 1M tokens.
Tools
Tool access not recorded
Reasoning budget
max
Framework
not recorded
Protocol
Toolathlon 108 tasks, three trials, internal harness.
Conditions
Adaptive thinking and max effort; offline snapshots pin financial feeds and container images; about a quarter of tasks are unsatisfiable as published.