HLE reasoning-only, no tools; thinking auto; max reasoning effort; total tokens across contexts capped at 1M; no context compaction; Claude Opus 4.6 grader; standard five-trial average applies to the headline result.
未知项
The card does not state a separate headline trial count; the §8.1 standard average of five trials applies.
工具
禁止工具
推理预算
max
框架
未记录
协议
HLE; no tools。
条件
2,500 questions; reasoning-only, no tools; thinking auto; max reasoning effort; total context tokens capped at 1M; no context compaction; Opus 4.6 grader; §8.1 five-trial average applies.
HLE with web search, web fetch, programmatic tool calling and code execution; thinking auto; max reasoning effort; total tokens across contexts capped at 1M; no context compaction; Claude Opus 4.6 grader; known HLE sources blocklisted and transcripts reviewed.
未知项
The card does not state a separate headline trial count; the §8.1 standard average of five trials applies. Single-run effort-chart points use distinct configs.
工具
允许工具
推理预算
max
框架
未记录
协议
HLE; with tools。
条件
2,500 questions; web search, web fetch, programmatic tool calling and code execution; thinking auto; max reasoning effort; 1M total-token cap; no context compaction; HLE source blocklist and Opus 4.6 transcript review; §8.1 five-trial average applies.
Claude Opus 4.7 · Humanity's Last Exam · 2,500-question benchmark · Scores and configurations
Claude Opus 4.7 record for Humanity's Last Exam · 2,500-question benchmark. 7 score records for this release, including 7 exact values (may include historical records). Includes 3 source locations.
Claude Opus 4.7 · Humanity's Last Exam scores and configurations
Metric and score
Configuration and evaluation conditions
Sources
Accuracy46.9%Reported 46.9% · Unit %
Published Unconfirmed
HLE 无工具
Settings
HLE reasoning-only, no tools; thinking auto; max reasoning effort; total tokens across contexts capped at 1M; no context compaction; Claude Opus 4.6 grader; standard five-trial average applies to the headline result.
Unknowns
The card does not state a separate headline trial count; the §8.1 standard average of five trials applies.
Tools
Tools forbidden
Reasoning budget
max
Framework
not recorded
Protocol
HLE; no tools。
Conditions
2,500 questions; reasoning-only, no tools; thinking auto; max reasoning effort; total context tokens capped at 1M; no context compaction; Opus 4.6 grader; §8.1 five-trial average applies.
HLE with web search, web fetch, programmatic tool calling and code execution; thinking auto; max reasoning effort; total tokens across contexts capped at 1M; no context compaction; Claude Opus 4.6 grader; known HLE sources blocklisted and transcripts reviewed.
Unknowns
The card does not state a separate headline trial count; the §8.1 standard average of five trials applies. Single-run effort-chart points use distinct configs.
Tools
Tools allowed
Reasoning budget
max
Framework
not recorded
Protocol
HLE; with tools。
Conditions
2,500 questions; web search, web fetch, programmatic tool calling and code execution; thinking auto; max reasoning effort; 1M total-token cap; no context compaction; HLE source blocklist and Opus 4.6 transcript review; §8.1 five-trial average applies.