Home Model series GPT Codex GPT-5.1 Codex-Max GPT-5.1 Codex-Max · SWE-Lancer · IC Diamond set · Scores and configurations GPT-5.1 Codex-Max · SWE-Lancer · IC Diamond set · Scores and configurations GPT-5.1 Codex-Max record for SWE-Lancer · IC Diamond set. 1 score record for this release, including 1 exact value (may include historical records). Includes 1 source location.
Scores and evaluation conditions GPT-5.1 Codex-Max · SWE-Lancer scores and configurations Metric and score Configuration and evaluation conditions Sources Score 80% Reported 80% · Unit % Published Unconfirmed
System Card reported effort Settings GPT-5.1-Codex-Max; benchmark-specific single-agent setup; effort not stated per figure. Unknowns SWE-Lancer与MLE-Bench图没有单独注明推理档位、采样参数或运行数;MLE具体运行时长未逐模型给出。 Tools Tool access not recorded Reasoning budget not recorded Framework not recorded Protocol SWE-Lancer IC SWE Diamond; July 17, 2025 dataset update; pass@1; no browsing. Conditions 原图明示百分比;未从柱高估数。GPT-5.1对照值属于后续来源。卡片当前修订时点未确认,publishedAt保持null;不混入内部PR/Proof Q&A或风险子任务。 View this score in rankings
Benchmark versions and metrics Aliases SWE-Lancer IC Diamond、SWE-Lancer IC SWE Diamond
Score · % · Higher is better Freelance coding task value · USD · Higher is better