DeepSeek-V4.1-Flash · Terminal-Bench(2.1 (Pass@1); across agent scaffolds at Max reasoning effort; unit not printed) 84.1 · 附件证据(deepseek-v41-flash-ev-002)

DeepSeek-V4.1-Flash 的 Terminal-Bench · 2.1 (Pass@1); across agent scaffolds at Max reasoning effort; unit not printed 官方出处。Codex v0.147.0 · 84.1。见《DeepSeek-V4.1-Flash Technical Report》PDF p.35; Table 4; full header and target row。证据 deepseek-v41-flash-ev-002。

原文与定位

DeepSeek-V4.1-Flash · Terminal-Bench(2.1 (Pass@1); across agent scaffolds at Max reasoning effort; unit not printed),Codex v0.147.0配置,Pass@1 84.1(具体成绩公布时间未确认)。见《DeepSeek-V4.1-Flash Technical Report》PDF p.35; Table 4; full header and target row。 查看成绩条件

DeepSeek Harness Benchmark (Metric) | Claude Code | Codex | OpenCode | Pi | mini-SWE | Minimal | Standard | PTC | Terminal-Bench v2.1 (Pass@1) | 88.0 | 84.1 | 85.0 | 86.1 | 90.3 | 90.6 | 85.8 | 85.8 |
官方材料
DeepSeek-V4.1-Flash Technical Report · PDF 第 35 页
定位
附件 · PDF p.35; Table 4; full header and target row
材料版本
Official V4.1-Flash report: 51/51 PDF pages read; Table 1, Table 3, Table 4, Table 5, multi-agent results and exact-label results were checked. CyberGym, SEC-Bench Pro and ExploitGym were retained as local audit only and excluded from regular mappings.
版本公布
未确认
披露时间
未确认 · 首发/后补未确认
采集时间
历史依据
暂无可靠历史版本依据
引用文本

DeepSeek-V4.1-Flash · Terminal-Bench(2.1 (Pass@1); across agent scaffolds at Max reasoning effort; unit not printed),Codex v0.147.0配置,Pass@1 84.1(具体成绩公布时间未确认)。官方出处 DeepSeek-V4.1-Flash Technical Report(附件,Official V4.1-Flash report: 51/51 PDF pages read; Table 1, Table 3, Table 4, Table 5, multi-agent results and exact-label results were checked. CyberGym, SEC-Bench Pro and ExploitGym were retained as local audit only and excluded from regular mappings.)PDF p.35; Table 4; full header and target row,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash/resolve/main/DeepSeek_V41_Tech_Report.pdf?download=true#page=35。Benchlog https://benchlog.lekshome.cc/evidence/v41-flash/deepseek-v41-flash-ev-002/

关联成绩与条件

DeepSeek-V4.1-Flash · Terminal-Bench 成绩与配置
指标与成绩配置与评测条件证据关系
Pass@184.1原文 84.1 · 单位 未标注
公布 未确认
Codex v0.147.0
设置
Codex v0.147.0 standard app-server mode with adapted tool schemas. Max reasoning effort; Linux containers, temperature=1.0, top-p=0.95, 1M context and max_steps=500 as stated in the report note. This is an ordinary single-agent public scaffold run, not the Section 5.3.5 multi-agent experiment.
未知项
Public reproducible ordinary single-agent scaffold at explicit Max reasoning effort. Presentation uses the existing max mode; scaffold and version remain conditions and do not create a separate effort tier.
工具
允许工具
推理预算
Max
框架
未记录
协议
Official DeepSeek-V4.1-Flash report Table 4; N=3 samples per task on Terminal-Bench v2.1.
条件
Codex v0.147.0 scaffold; Max reasoning effort. Table does not print a percent sign. Ordinary single-agent public scaffold; not a cross-version average or multi-agent run.

直接支持该成绩

在排名中查看此成绩