Claude Sonnet 5 · BrowseComp · 1,266 题;单代理与多代理按协议区分 · 成绩与配置

Claude Sonnet 5 的 BrowseComp · 1,266 题;单代理与多代理按协议区分 记录。本次发布有 3 条成绩记录,含 3 条精确值(可含历史记录),附 4 条来源定位。

成绩与评测条件

Claude Sonnet 5 · BrowseComp 成绩与配置
指标与成绩配置与评测条件出处
Accuracy84.7%原文 84.7% · 单位 %
公布 未确认
Standard configuration: adaptive thinking, max effort
设置
Adaptive thinking at max effort; default temperature and top_p; five-trial averages unless otherwise stated.
未知项
Context-window size is evaluation-dependent; standard configuration is 1M tokens.
工具
允许工具
推理预算
max
框架
未记录
协议
BrowseComp with web search, web fetch, programmatic tool calling and code execution.
条件
Adaptive thinking, max effort, 10M token limit, 200K context compaction, evaluation blocklist. Original page chart was replaced after the source identified a simpler methodology; prior numeric value was not given and is not reconstructed.
在排名中查看此成绩
Accuracy79.3%原文 79.3% · 单位 %
公布 未确认
BrowseComp max effort, 1M-token limit
设置
Adaptive thinking at max effort with web search, web fetch, programmatic tool calling, and code execution; 1M-token limit.
未知项
Whether context compaction was used at this token limit is not stated.
工具
允许工具
推理预算
max
框架
未记录
协议
BrowseComp Figure 8.9.2.A, test-time compute scaling at max effort with web search, web fetch, programmatic tool calling, and code execution.
条件
1M-token limit as labeled. The figure gives no exact per-point cost label.
Accuracy82.9%原文 82.9% · 单位 %
公布 未确认
BrowseComp max effort, 3M-token limit
设置
Adaptive thinking at max effort with web search, web fetch, programmatic tool calling, and code execution; 3M-token limit; context compaction is reported as triggering at 200K tokens when extending beyond the 1M context window.
未知项
Sampling parameters are not stated.
工具
允许工具
推理预算
max
框架
未记录
协议
BrowseComp Figure 8.9.2.A, test-time compute scaling at max effort with web search, web fetch, programmatic tool calling, and code execution.
条件
3M-token limit as labeled; §8.9.2 reports context compaction triggered at 200K tokens to extend beyond the 1M context window. The figure gives no exact per-point cost label.

出处与披露

测试版本与指标

别名 BrowseComp、Multi-agent BrowseComp

  • Accuracy · % · 越高越好