DeepSeek-V4.1-Flash · ProgramBench(High-confidence 172-task subset; Almost@1; multi-agent; 8-hour deadline) 30.04% · 附件证据(deepseek-v41-flash-ev-023)

DeepSeek-V4.1-Flash 的 ProgramBench · High-confidence 172-task subset; Almost@1; multi-agent; 8-hour deadline 官方出处。DeepSeek-V4.1-Flash multi-agent 8h · 30.04%。见《DeepSeek-V4.1-Flash Technical Report》PDF pp.35-36; Section 5.3.5; exact prose values。证据 deepseek-v41-flash-ev-023。

原文与定位

DeepSeek-V4.1-Flash · ProgramBench(High-confidence 172-task subset; Almost@1; multi-agent; 8-hour deadline),DeepSeek-V4.1-Flash multi-agent 8h配置,Almost@1 30.04%(具体成绩公布时间未确认)。见《DeepSeek-V4.1-Flash Technical Report》PDF pp.35-36; Section 5.3.5; exact prose values。 查看成绩条件

ProgramBench Almost@1; FrontierSWE v2 Mean@5 Multi-agent ProgramBench reaches 30.04% at 8 hours versus 20.39% for single-agent; FrontierSWE v2 Mean@5 reaches 32.90% at 20 hours versus 28.20% for single-agent.
官方材料
DeepSeek-V4.1-Flash Technical Report · PDF 第 36 页
定位
附件 · PDF pp.35-36; Section 5.3.5; exact prose values
材料版本
Official V4.1-Flash report: 51/51 PDF pages read; Table 1, Table 3, Table 4, Table 5, multi-agent results and exact-label results were checked. CyberGym, SEC-Bench Pro and ExploitGym were retained as local audit only and excluded from regular mappings.
版本公布
未确认
披露时间
未确认 · 首发/后补未确认
采集时间
历史依据
暂无可靠历史版本依据
引用文本

DeepSeek-V4.1-Flash · ProgramBench(High-confidence 172-task subset; Almost@1; multi-agent; 8-hour deadline),DeepSeek-V4.1-Flash multi-agent 8h配置,Almost@1 30.04%(具体成绩公布时间未确认)。官方出处 DeepSeek-V4.1-Flash Technical Report(附件,Official V4.1-Flash report: 51/51 PDF pages read; Table 1, Table 3, Table 4, Table 5, multi-agent results and exact-label results were checked. CyberGym, SEC-Bench Pro and ExploitGym were retained as local audit only and excluded from regular mappings.)PDF pp.35-36; Section 5.3.5; exact prose values,https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash/resolve/main/DeepSeek_V41_Tech_Report.pdf?download=true#page=36。Benchlog https://benchlog.lekshome.cc/evidence/v41-flash/deepseek-v41-flash-ev-023/

关联成绩与条件

DeepSeek-V4.1-Flash · ProgramBench 成绩与配置
指标与成绩配置与评测条件证据关系
Almost@130.04%原文 30.04% · 单位 %
公布 未确认
DeepSeek-V4.1-Flash multi-agent 8h
设置
Official V4.1 report Section 5.3.5; up to three rollouts per task and an 8-hour per-rollout deadline.
未知项
Multi-agent experiments are explicitly excluded from the regular presentation under SPEC.
工具
工具条件未记录
推理预算
未记录
框架
未记录
协议
Official V4.1 report Section 5.3.5; up to three rollouts per task and an 8-hour per-rollout deadline.
条件
Multi-agent peak value at the 8-hour deadline; preliminary experiment excluded from regular presentation.

直接支持该成绩

在排名中查看此成绩