System Card §8.1 standard configuration: adaptive thinking at max effort; default temperature/top_p; averaged over 5 trials. Context sizes are evaluation-dependent and do not exceed 1M tokens; retain all section-specific exceptions on their results.
未知项
Per-benchmark tools, context/token cap, resolution, trial count, harness and other exceptions are recorded on each result when stated.
工具
工具条件未记录
推理预算
max
框架
未记录
协议
SWE-bench Multilingual; 300 problems across 9 programming languages.
条件
All SWE-bench variants use the standard configuration with thinking blocks included; average over 5 trials.
Adaptive thinking · max effort (card-wide default)
设置
System Card §8.1 default: adaptive thinking at max effort, default sampling settings (temperature/top_p), averaged over five trials unless otherwise noted; context varies by evaluation and does not exceed 1M tokens.
未知项
Per-benchmark exceptions and harness details are recorded on the relevant configurations/results.
工具
工具条件未记录
推理预算
max
框架
未记录
协议
SWE-bench Multilingual; 300 problems across 9 languages.
条件
Five-trial average; card-wide default adaptive max effort and default sampling.
System Card max effort (per-result benchmark harnesses)
设置
System Card §8.1 default: adaptive thinking/max effort and default sampling settings unless a section says otherwise. Benchmark tools, evaluator, safeguards, fallback, and repetitions remain per-result conditions; this config represents the stated model effort, not harness equivalence.
未知项
Exact run time is not disclosed.、Per-benchmark tools, safeguards, and repetition counts are specified only where the source states them.
工具
工具条件未记录
推理预算
max
框架
未记录
协议
300 problems across nine programming languages; five trials averaged.
条件
Exact harness and run date are not stated. Source-wide conditions: Each score is averaged over five trials; Multilingual has 300 problems across nine languages.
Claude Opus · SWE-bench Multilingual · 300 problems, 9 programming languages · Release history
View scores, configurations, and disclosures for SWE-bench Multilingual · 300 problems, 9 programming languages across 6 Claude Opus releases, ordered by release date.
Differences are calculated only for unique, active, exact values between direct predecessors when the unit, metric, and explicitly recorded configuration and conditions match.
· 1 score record for this release, including 1 exact value (may include historical records)
Records for the direct predecessor do not provide matching conditions for a valid difference.
Claude Opus 4.7 · SWE-bench Multilingual scores and configurations
Metric and score
Configuration and evaluation conditions
Sources
Pass rate80.5%Reported 80.5% · Unit %
Published Unconfirmed
发布表报告值
Settings
System Card §8.1 standard configuration: adaptive thinking at max effort; default temperature/top_p; averaged over 5 trials. Context sizes are evaluation-dependent and do not exceed 1M tokens; retain all section-specific exceptions on their results.
Unknowns
Per-benchmark tools, context/token cap, resolution, trial count, harness and other exceptions are recorded on each result when stated.
Tools
Tool access not recorded
Reasoning budget
max
Framework
not recorded
Protocol
SWE-bench Multilingual; 300 problems across 9 programming languages.
Conditions
All SWE-bench variants use the standard configuration with thinking blocks included; average over 5 trials.
· 1 score record for this release, including 1 exact value (may include historical records)
Records for the direct predecessor do not provide matching conditions for a valid difference.
Claude Opus 5 · SWE-bench Multilingual scores and configurations
Metric and score
Configuration and evaluation conditions
Sources
Pass rate89.5%Reported 89.5% · Unit %
Published Unconfirmed
Adaptive thinking · max effort (card-wide default)
Settings
System Card §8.1 default: adaptive thinking at max effort, default sampling settings (temperature/top_p), averaged over five trials unless otherwise noted; context varies by evaluation and does not exceed 1M tokens.
Unknowns
Per-benchmark exceptions and harness details are recorded on the relevant configurations/results.
Tools
Tool access not recorded
Reasoning budget
max
Framework
not recorded
Protocol
SWE-bench Multilingual; 300 problems across 9 languages.
Conditions
Five-trial average; card-wide default adaptive max effort and default sampling.
· 1 score record for this release, including 1 exact value (may include historical records)
Records for the direct predecessor do not provide matching conditions for a valid difference.
Claude Opus 5.5 · SWE-bench Multilingual scores and configurations
Metric and score
Configuration and evaluation conditions
Sources
Pass rate93.9%Reported 93.9% · Unit %
Published Unconfirmed
System Card max effort (per-result benchmark harnesses)
Settings
System Card §8.1 default: adaptive thinking/max effort and default sampling settings unless a section says otherwise. Benchmark tools, evaluator, safeguards, fallback, and repetitions remain per-result conditions; this config represents the stated model effort, not harness equivalence.
Unknowns
Exact run time is not disclosed.、Per-benchmark tools, safeguards, and repetition counts are specified only where the source states them.
Tools
Tool access not recorded
Reasoning budget
max
Framework
not recorded
Protocol
300 problems across nine programming languages; five trials averaged.
Conditions
Exact harness and run date are not stated. Source-wide conditions: Each score is averaged over five trials; Multilingual has 300 problems across nine languages.