Claude Sonnet 5 · Humanity's Last Exam(2,500-question benchmark) · 附件证据(ev5-hle-method)
Claude Sonnet 5 的 Humanity's Last Exam · 2,500-question benchmark 官方出处。见《Claude Sonnet 5 System Card》§8.9.1, PDF p.122。证据 ev5-hle-method。
原文与定位
Claude Sonnet 5 · Humanity's Last Exam(2,500-question benchmark),Thinking set to auto配置,Accuracy 43.2%(具体成绩公布时间未确认)。见《Claude Sonnet 5 System Card》§8.9.1, PDF p.122。 查看成绩条件
Claude Sonnet 5 · Humanity's Last Exam(2,500-question benchmark),Thinking set to auto, with tools配置,Accuracy 57.4%(具体成绩公布时间未确认)。见《Claude Sonnet 5 System Card》§8.9.1, PDF p.122。 查看成绩条件
Humanity’s Last Exam (HLE) is a multi-modal benchmark at the frontier of human knowledge, comprising 2,500 questions. We tested Claude Sonnet 5 in two configurations: (1) reasoning-only without tools, and (2) with web search, web fetch, programmatic tool calling, and code execution. In all runs, thinking was set to auto and the total tokens used across contexts was capped at 1M. Context compaction was not used for these results. Claude Opus 4.6 served as the model grader.
- 官方材料
- Claude Sonnet 5 System Card · PDF 第 122 页
- 定位
- 附件 · §8.9.1, PDF p.122
- 材料版本
- PDF with changelog dated 2026-07-10; 146 pages; collected 2026-11-10
- 版本公布
- 未确认
- 披露时间
- 未确认 · 首发/后补未确认
- 采集时间
- 历史依据
- 暂无可靠历史版本依据
引用文本
Claude Sonnet 5 · Humanity's Last Exam(2,500-question benchmark),Thinking set to auto配置,Accuracy 43.2%(具体成绩公布时间未确认);Claude Sonnet 5 · Humanity's Last Exam(2,500-question benchmark),Thinking set to auto, with tools配置,Accuracy 57.4%(具体成绩公布时间未确认)。官方出处 Claude Sonnet 5 System Card(附件,PDF with changelog dated 2026-07-10; 146 pages; collected 2026-11-10)§8.9.1, PDF p.122,https://www.anthropic.com/claude-sonnet-5-system-card#page=122。Benchlog https://benchlog.lekshome.cc/evidence/claude-sonnet-5/ev5-hle-method/
关联成绩与条件
| 指标与成绩 | 配置与评测条件 | 证据关系 |
|---|---|---|
| Accuracy43.2%原文 43.2% · 单位 % 公布 未确认 | Thinking set to auto
| 直接支持该成绩 在排名中查看此成绩 |
| Accuracy57.4%原文 57.4% · 单位 % 公布 未确认 | Thinking set to auto, with tools
| 直接支持该成绩 在排名中查看此成绩 |