Home Model series Claude Sonnet Claude Sonnet 5 Claude Sonnet 5 · SWE-bench Pro · Pro · Scores and configurations Claude Sonnet 5 · SWE-bench Pro · Pro · Scores and configurations Claude Sonnet 5 record for SWE-bench Pro · Pro. 1 score record for this release, including 1 exact value (may include historical records). Includes 2 source locations.
Scores and evaluation conditions Claude Sonnet 5 · SWE-bench Pro scores and configurations Metric and score Configuration and evaluation conditions Sources Pass rate 63.2% Reported 63.2% · Unit % Published Unconfirmed
Standard configuration: adaptive thinking, max effort Settings Adaptive thinking at max effort; default temperature and top_p; five-trial averages unless otherwise stated. Unknowns Context-window size is evaluation-dependent; standard configuration is 1M tokens. Tools Tool access not recorded Reasoning budget max Framework not recorded Protocol SWE-bench Pro; actively maintained repositories, large multi-file diffs and reduced public ground-truth leakage; five trials. Conditions Standard configuration; thinking blocks included in sampling results. View this score in rankings
Benchmark versions and metrics Aliases SWE-Bench Pro
Pass rate · % · Higher is better