Home Model series Claude Haiku Claude Haiku 4.5 Claude Haiku 4.5 · SWE-bench Verified · Verified subset (500 problems) · Scores and configurations Claude Haiku 4.5 · SWE-bench Verified · Verified subset (500 problems) · Scores and configurations Claude Haiku 4.5 record for SWE-bench Verified · Verified subset (500 problems). 1 score record for this release, including 1 exact value (may include historical records). Includes 1 source location.
Scores and evaluation conditions Claude Haiku 4.5 · SWE-bench Verified scores and configurations Metric and score Configuration and evaluation conditions Sources Pass rate 73.3% Reported 73.3% · Unit % Published Unconfirmed
发布表报告值 Settings SWE-bench: full 500 problems, 50 trials, no test-time compute, 128K thinking budget, default sampling; Terminal-Bench: Terminus 2, 11 runs split between no thinking and 32K thinking; OSWorld: OSWorld-Verified, 100 steps, 4 runs; GPQA/MMMLU/MMMU follow source table. Unknowns AIME 的 Python 工具使用情况按两个分列配置保存;其余各项的逐行配置以主文脚注为准。 Tools Tools allowed Reasoning budget Thinking budget 128K Framework not recorded Protocol SWE-bench Verified full 500-problem set; 50 trials; no test-time compute。 Conditions 128K thinking budget; default sampling。 View this score in rankings
Benchmark versions and metrics Aliases SWE-bench Verified
Pass rate · % · Higher is better