Home Model series GPT unsuffixed models GPT-5.1 GPT-5.1 · SWE-Lancer · IC Diamond set · Scores and configurations GPT-5.1 · SWE-Lancer · IC Diamond set · Scores and configurations GPT-5.1 record for SWE-Lancer · IC Diamond set. 1 score record for this release, including 1 exact value (may include historical records). Includes 1 source location.
Scores and evaluation conditions GPT-5.1 · SWE-Lancer scores and configurations Metric and score Configuration and evaluation conditions Sources Score 62% Reported 62% · Unit % Published Unconfirmed
Codex-Max system-card later comparison Settings GPT-5.1 comparison bars in the GPT-5.1-Codex-Max System Card; per-model effort not independently identified. Unknowns 比较图没有逐模型明确所有采样与effort设置;不根据对照模型或token预算推定档位。 Tools Tool access not recorded Reasoning budget not recorded Framework not recorded Protocol SWE-Lancer IC SWE Diamond; July 17, 2025 dataset update; pass@1; no browsing. Conditions 原图明示百分比;未从柱高估数。GPT-5.1对照值属于后续来源。卡片当前修订时点未确认,publishedAt保持null;不混入内部PR/Proof Q&A或风险子任务。 View this score in rankings
Benchmark versions and metrics Aliases SWE-Lancer IC Diamond、SWE-Lancer IC SWE Diamond
Score · % · Higher is better Freelance coding task value · USD · Higher is better