除特别注明外 adaptive thinking/max effort。 Source-wide conditions: Cognition ran the evaluations in Claude Code; mean@5. Main and Extended are separate benchmark definitions.
Explicit medium effort; Cognition evaluation in Claude Code. Mean@5.
未知项
No API-equivalent harness or run date is stated.
工具
工具条件未记录
推理预算
medium
框架
Cognition Claude Code harness
协议
FrontierCode v1.1 Main; Cognition Claude Code harness; mean@5; medium effort.
条件
Best reported effort. Evaluation has internet access; no timeout information is stated. Do not infer effort from output tokens. Source-wide conditions: Cognition ran the evaluations in Claude Code; mean@5. Main and Extended are separate benchmark definitions.
Differences are calculated only for unique, active, exact values between direct predecessors when the unit, metric, and explicitly recorded configuration and conditions match.
除特别注明外 adaptive thinking/max effort。 Source-wide conditions: Cognition ran the evaluations in Claude Code; mean@5. Main and Extended are separate benchmark definitions.
Explicit medium effort; Cognition evaluation in Claude Code. Mean@5.
Unknowns
No API-equivalent harness or run date is stated.
Tools
Tool access not recorded
Reasoning budget
medium
Framework
Cognition Claude Code harness
Protocol
FrontierCode v1.1 Main; Cognition Claude Code harness; mean@5; medium effort.
Conditions
Best reported effort. Evaluation has internet access; no timeout information is stated. Do not infer effort from output tokens. Source-wide conditions: Cognition ran the evaluations in Claude Code; mean@5. Main and Extended are separate benchmark definitions.