DeepSeek-R1-Zero · 官方评测披露
DeepSeek-R1-Zero 当前收录 24 项测试的官方记录。已完成列明材料的核查。
模型发布 · DeepSeek R1 Zero
官方材料与核查范围
All listed official model-card, official News/API, metadata and directly linked technical-report materials for this release were read through the requested scope. Tables without an explicit unit retain an empty unit; figures without exact labels were not estimated. 核对时间 。
当前资料不足以还原首发。 No reliable historical snapshot proving the complete launch-day material set was obtained. Official publication dates and current materials do not substitute for a launch snapshot.
- DeepSeek-R1-Zero official Hugging Face model card · 主文 · HF revision 72234287cbc67dbf474d911359ae32b61a2fdc7e; full Markdown reviewed公布 未确认 · 采集 · 已核查 Official model-card Markdown read in full; benchmark rows, notes, configuration statements and linked reports checked.
- DeepSeek-R1-Zero official Hugging Face model card metadata · 主文 · author=deepseek-ai; sha=72234287cbc67dbf474d911359ae32b61a2fdc7e; repository timestamps used only as repository facts公布 未确认 · 采集 · 已核查 Official model API metadata checked for author, repository identity, revision and timestamps; createdAt was never used as release date.
- DeepSeek-R1 发布,性能对标 OpenAI o1 正式版 · 主文 · Official dated DeepSeek announcement; release date 2025-01-20; the announcement explicitly names this checkpoint.公布 · 采集 · 已核查 The official dated entry or current service table was read for this release scope; aliases were not treated as weight checkpoints.
- DeepSeek-R1 paper · 附件 · Official DeepSeek-R1 paper: 86/86 PDF pages read; Table 3, Table 8, Table 13, Table 14 and Table 15 checked. Safety, jailbreak and attack sections pp.44-54 were retained as local audit only and excluded from regular mappings.公布 未确认 · 采集 · 已核查 Official DeepSeek-R1 paper: 86/86 PDF pages read; Table 3, Table 8, Table 13, Table 14 and Table 15 checked. Safety, jailbreak and attack sections pp.44-54 were retained as local audit only and excluded from regular mappings.
配置
- DeepSeek-R1-Zero reported evaluation · Pure-RL R1-Zero checkpoint; report protocol uses sampled Pass@1 with maximum generation length 32,768 and row-specific benchmark settings. 输出上限 32768 tokens未知项 The paper table does not print percent signs.、Per-row response counts are not repeated in Table 3.
直接前代与后续发布
当前收录未确认直接前代。 官方关系依据
测试记录 · 24
- MMLU · DeepSeek-R1 paper Table 3; MMLU (EM); unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- MMLU-Redux · DeepSeek-R1 paper Table 3; MMLU-Redux (EM); unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- MMLU-Pro · DeepSeek-R1 paper Table 3; MMLU-Pro (EM); unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- DROP · DeepSeek-R1 paper Table 3; DROP (3-shot F1); unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- IF-Eval · DeepSeek-R1 paper Table 3; IF-Eval (PromptStrict); unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- GPQA Diamond · DeepSeek-R1 paper Table 3; GPQA Diamond (Pass@1); unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- SimpleQA · DeepSeek-R1 paper Table 3; SimpleQA (Correct); unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- FRAMES · DeepSeek-R1 paper Table 3; FRAMES (Acc.); unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- AlpacaEval 2.0 · DeepSeek-R1 paper Table 3; AlpacaEval 2.0 (LC-winrate); unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- Arena-Hard · DeepSeek-R1 paper Table 3; Arena-Hard (GPT-4-1106); unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- LiveCodeBench · DeepSeek-R1 paper Table 3; LiveCodeBench (Pass@1-COT); unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- Codeforces · DeepSeek-R1 paper Table 3; Codeforces (Percentile); unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- Codeforces · DeepSeek-R1 paper Table 3; Codeforces (Rating); unit printed as rating本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- SWE Verified · DeepSeek-R1 paper Table 3; SWE Verified (Resolved); unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- Aider-Polyglot · DeepSeek-R1 paper Table 3; Aider-Polyglot (Acc.); unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- AIME · DeepSeek-R1 paper Table 3; 2024 (Pass@1); unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- MATH-500 · DeepSeek-R1 paper Table 3; MATH-500 (Pass@1); unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- CNMO · DeepSeek-R1 paper Table 3; CNMO 2024 (Pass@1); unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- CLUEWSC · DeepSeek-R1 paper Table 3; CLUEWSC (EM); unit not printed (ds-completion-r1-zero-cluewsc-em)本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- C-Eval · DeepSeek-R1 paper Table 3; C-Eval (EM); unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- C-SimpleQA · DeepSeek-R1 paper Table 3; C-SimpleQA (Correct); unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- LiveCodeBench · Difficulty subset Easy; DeepSeek-R1 paper Table 14; unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- LiveCodeBench · Difficulty subset Medium; DeepSeek-R1 paper Table 14; unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- LiveCodeBench · Difficulty subset Hard; DeepSeek-R1 paper Table 14; unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)