Home Model series Claude Sonnet Claude Sonnet 4.6 Claude Sonnet 4.6 · SWE-bench Multilingual · 300 problems, 9 programming languages · Scores and configurations Claude Sonnet 4.6 · SWE-bench Multilingual · 300 problems, 9 programming languages · Scores and configurations Claude Sonnet 4.6 record for SWE-bench Multilingual · 300 problems, 9 programming languages. 1 score record for this release, including 1 exact value (may include historical records). Includes 1 source location.
Scores and evaluation conditions Claude Sonnet 4.6 · SWE-bench Multilingual scores and configurations Metric and score Configuration and evaluation conditions Sources Pass rate 75.9% Reported 75.9% · Unit % Published Unconfirmed
Adaptive thinking, max effort Settings Adaptive thinking enabled; max effort; default temperature and top_p unless an evaluation specifies otherwise. Unknowns Context window is evaluation-dependent; Table 2.1.A states it does not exceed 1M tokens. Tools Tool access not recorded Reasoning budget max Framework not recorded Protocol 300 problems across 9 programming languages; 10 trials. Conditions Adaptive thinking, max effort, default sampling; thinking blocks included in sampling results. View this score in rankings
Sources and disclosures §2.2, PDF p.16 Attachment · Claude Sonnet 4.6 System Card Benchmark versions and metrics Aliases SWE-Bench Multilingual
Pass rate · % · Higher is better