Standard configuration: adaptive thinking, max effort
设置
Adaptive thinking at max effort; default temperature and top_p; five-trial averages unless otherwise stated.
未知项
Context-window size is evaluation-dependent; standard configuration is 1M tokens.
工具
工具条件未记录
推理预算
max
框架
未记录
协议
OSWorld-Verified first-attempt success rate, five-run average; 361 tasks and 100 steps per task.
条件
Adaptive thinking at max effort, default 1080p settings. Protocol includes zoom-tool bug fix for batched actions and per-turn token limit increase from 16K to 128K; main page reports only Sonnet 5's score, not the Sonnet 4.6 cross-reference value.
Claude Sonnet 5 · OSWorld-Verified · Verified benchmark; evaluation protocol noted per source · Scores and configurations
Claude Sonnet 5 record for OSWorld-Verified · Verified benchmark; evaluation protocol noted per source. 1 score record for this release, including 1 exact value (may include historical records). Includes 2 source locations.
Claude Sonnet 5 · OSWorld-Verified scores and configurations
Metric and score
Configuration and evaluation conditions
Sources
First-attempt success rate81.2%Reported 81.2% · Unit %
Published Unconfirmed
Standard configuration: adaptive thinking, max effort
Settings
Adaptive thinking at max effort; default temperature and top_p; five-trial averages unless otherwise stated.
Unknowns
Context-window size is evaluation-dependent; standard configuration is 1M tokens.
Tools
Tool access not recorded
Reasoning budget
max
Framework
not recorded
Protocol
OSWorld-Verified first-attempt success rate, five-run average; 361 tasks and 100 steps per task.
Conditions
Adaptive thinking at max effort, default 1080p settings. Protocol includes zoom-tool bug fix for batched actions and per-turn token limit increase from 16K to 128K; main page reports only Sonnet 5's score, not the Sonnet 4.6 cross-reference value.