900 multi-hop web-research prompts; web search, web fetch, and programmatic tool calling; adaptive thinking; figure states a 980K-token budget; section states a 1M budget and no context compaction. Explicit adaptive-thinking effort: low.
未知项
The card does not state any additional sampling parameters beyond the cited evaluation description.
工具
允许工具
推理预算
low
框架
未记录
协议
DeepSearchQA; mean F1 across 900 multi-hop web-research questions.
条件
Explicit effort labels; figure budget 980K tokens; section describes web search, web fetch, programmatic tools, 1M token budget, no context compaction.
900 multi-hop web-research prompts; web search, web fetch, and programmatic tool calling; adaptive thinking; figure states a 980K-token budget; section states a 1M budget and no context compaction. Explicit adaptive-thinking effort: medium.
未知项
The card does not state any additional sampling parameters beyond the cited evaluation description.
工具
允许工具
推理预算
medium
框架
未记录
协议
DeepSearchQA; mean F1 across 900 multi-hop web-research questions.
条件
Explicit effort labels; figure budget 980K tokens; section describes web search, web fetch, programmatic tools, 1M token budget, no context compaction.
900 multi-hop web-research prompts; web search, web fetch, and programmatic tool calling; adaptive thinking; figure states a 980K-token budget; section states a 1M budget and no context compaction. Explicit adaptive-thinking effort: high.
未知项
The card does not state any additional sampling parameters beyond the cited evaluation description.
工具
允许工具
推理预算
high
框架
未记录
协议
DeepSearchQA; mean F1 across 900 multi-hop web-research questions.
条件
Explicit effort labels; figure budget 980K tokens; section describes web search, web fetch, programmatic tools, 1M token budget, no context compaction.
900 multi-hop web-research prompts; web search, web fetch, and programmatic tool calling; adaptive thinking; figure states a 980K-token budget; section states a 1M budget and no context compaction. Explicit adaptive-thinking effort: xhigh.
未知项
The card does not state any additional sampling parameters beyond the cited evaluation description.
工具
允许工具
推理预算
xhigh
框架
未记录
协议
DeepSearchQA; mean F1 across 900 multi-hop web-research questions.
条件
Explicit effort labels; figure budget 980K tokens; section describes web search, web fetch, programmatic tools, 1M token budget, no context compaction.
900 multi-hop web-research prompts; web search, web fetch, and programmatic tool calling; adaptive thinking; figure states a 980K-token budget; section states a 1M budget and no context compaction. Explicit adaptive-thinking effort: max.
未知项
The card does not state any additional sampling parameters beyond the cited evaluation description.
工具
允许工具
推理预算
max
框架
未记录
协议
DeepSearchQA; mean F1 across 900 multi-hop web-research questions.
条件
Explicit effort labels; figure budget 980K tokens; section describes web search, web fetch, programmatic tools, 1M token budget, no context compaction.
Claude Opus 5 · DeepSearchQA · 900 prompts;单代理与多代理按协议区分 · Scores and configurations
Claude Opus 5 record for DeepSearchQA · 900 prompts;单代理与多代理按协议区分. 5 score records for this release, including 5 exact values (may include historical records). Includes 1 source location.
Claude Opus 5 · DeepSearchQA scores and configurations
Metric and score
Configuration and evaluation conditions
Sources
F1 score91%Reported 91% · Unit %
Published Unconfirmed
DeepSearchQA · Low effort
Settings
900 multi-hop web-research prompts; web search, web fetch, and programmatic tool calling; adaptive thinking; figure states a 980K-token budget; section states a 1M budget and no context compaction. Explicit adaptive-thinking effort: low.
Unknowns
The card does not state any additional sampling parameters beyond the cited evaluation description.
Tools
Tools allowed
Reasoning budget
low
Framework
not recorded
Protocol
DeepSearchQA; mean F1 across 900 multi-hop web-research questions.
Conditions
Explicit effort labels; figure budget 980K tokens; section describes web search, web fetch, programmatic tools, 1M token budget, no context compaction.
900 multi-hop web-research prompts; web search, web fetch, and programmatic tool calling; adaptive thinking; figure states a 980K-token budget; section states a 1M budget and no context compaction. Explicit adaptive-thinking effort: medium.
Unknowns
The card does not state any additional sampling parameters beyond the cited evaluation description.
Tools
Tools allowed
Reasoning budget
medium
Framework
not recorded
Protocol
DeepSearchQA; mean F1 across 900 multi-hop web-research questions.
Conditions
Explicit effort labels; figure budget 980K tokens; section describes web search, web fetch, programmatic tools, 1M token budget, no context compaction.
900 multi-hop web-research prompts; web search, web fetch, and programmatic tool calling; adaptive thinking; figure states a 980K-token budget; section states a 1M budget and no context compaction. Explicit adaptive-thinking effort: high.
Unknowns
The card does not state any additional sampling parameters beyond the cited evaluation description.
Tools
Tools allowed
Reasoning budget
high
Framework
not recorded
Protocol
DeepSearchQA; mean F1 across 900 multi-hop web-research questions.
Conditions
Explicit effort labels; figure budget 980K tokens; section describes web search, web fetch, programmatic tools, 1M token budget, no context compaction.
900 multi-hop web-research prompts; web search, web fetch, and programmatic tool calling; adaptive thinking; figure states a 980K-token budget; section states a 1M budget and no context compaction. Explicit adaptive-thinking effort: xhigh.
Unknowns
The card does not state any additional sampling parameters beyond the cited evaluation description.
Tools
Tools allowed
Reasoning budget
xhigh
Framework
not recorded
Protocol
DeepSearchQA; mean F1 across 900 multi-hop web-research questions.
Conditions
Explicit effort labels; figure budget 980K tokens; section describes web search, web fetch, programmatic tools, 1M token budget, no context compaction.
900 multi-hop web-research prompts; web search, web fetch, and programmatic tool calling; adaptive thinking; figure states a 980K-token budget; section states a 1M budget and no context compaction. Explicit adaptive-thinking effort: max.
Unknowns
The card does not state any additional sampling parameters beyond the cited evaluation description.
Tools
Tools allowed
Reasoning budget
max
Framework
not recorded
Protocol
DeepSearchQA; mean F1 across 900 multi-hop web-research questions.
Conditions
Explicit effort labels; figure budget 980K tokens; section describes web search, web fetch, programmatic tools, 1M token budget, no context compaction.