Home Model series Claude Sonnet Claude Sonnet 5 Claude Sonnet 5 · SWE-bench Verified · Verified subset (500 problems) · Scores and configurations Claude Sonnet 5 · SWE-bench Verified · Verified subset (500 problems) · Scores and configurations Claude Sonnet 5 record for SWE-bench Verified · Verified subset (500 problems). 1 score record for this release, including 1 exact value (may include historical records). Includes 1 source location.
Scores and evaluation conditions Claude Sonnet 5 · SWE-bench Verified scores and configurations Metric and score Configuration and evaluation conditions Sources Pass rate 85.2% Reported 85.2% · Unit % Published Unconfirmed
Standard configuration: adaptive thinking, max effort Settings Adaptive thinking at max effort; default temperature and top_p; five-trial averages unless otherwise stated. Unknowns Context-window size is evaluation-dependent; standard configuration is 1M tokens. Tools Tool access not recorded Reasoning budget max Framework not recorded Protocol SWE-bench Verified 500-problem subset; five trials. Conditions All variants use the standard configuration; thinking blocks included in sampling results. View this score in rankings
Sources and disclosures §8.2, PDF p.116 Attachment · Claude Sonnet 5 System Card Benchmark versions and metrics Aliases SWE-bench Verified
Pass rate · % · Higher is better