DeepSeek-V3-Base · 官方评测披露
DeepSeek-V3-Base 当前收录 32 项测试的官方记录。已完成列明材料的核查。
模型发布 · DeepSeek V3 Base
官方材料与核查范围
All listed official model-card, official News/API, metadata and directly linked technical-report materials for this release were read through the requested scope. Tables without an explicit unit retain an empty unit; figures without exact labels were not estimated. 核对时间 。
当前资料不足以还原首发。 No reliable historical snapshot proving the complete launch-day material set was obtained. Official publication dates and current materials do not substitute for a launch snapshot.
- DeepSeek-V3 official Hugging Face model card · 主文 · HF revision e815299b0bcbac849fa540c768ef21845365c9eb; Base table and model-card Markdown reviewed in full公布 未确认 · 采集 · 已核查 Official model-card Markdown read in full; benchmark rows, notes, configuration statements and linked reports checked.
- DeepSeek-V3 official Hugging Face model card metadata · 主文 · author=deepseek-ai; sha=e815299b0bcbac849fa540c768ef21845365c9eb; repository timestamps used only as repository facts公布 未确认 · 采集 · 已核查 Official model API metadata checked for author, repository identity, revision and timestamps; createdAt was never used as release date.
- DeepSeek-V3 正式发布 · 主文 · Official dated DeepSeek announcement; release date 2024-12-26; the announcement explicitly names this checkpoint.公布 · 采集 · 已核查 The official dated entry or current service table was read for this release scope; aliases were not treated as weight checkpoints.
- DeepSeek-V3 Technical Report · 附件 · Official arXiv technical report: 53/53 PDF pages read; Table 3 (V3-Base), Table 6 (V3 Chat), Table 7 and Table 8 integrated. Figures without exact labels were not estimated.公布 未确认 · 采集 · 已核查 Official arXiv technical report: 53/53 PDF pages read; Table 3 (V3-Base), Table 6 (V3 Chat), Table 7 and Table 8 integrated. Figures without exact labels were not estimated.
配置
- DeepSeek-V3-Base · Base checkpoint, evaluated in the report's internal HAI-LLM framework with row-specific shot counts. 未知项 Do not merge with the V3 Chat model column.、The table does not print percent signs.
直接前代与后续发布
当前收录未确认直接前代。 官方关系依据
测试记录 · 32
- Pile-test · DeepSeek-V3 Technical Report Table 3; Pile-test (BPB); unit is printed as BPB本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- BBH · DeepSeek-V3 Technical Report Table 3; BBH (EM); unit is not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- MMLU · DeepSeek-V3 Technical Report Table 3; MMLU (EM); unit is not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- MMLU-Redux · DeepSeek-V3 Technical Report Table 3; MMLU-Redux (EM); unit is not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- MMLU-Pro · DeepSeek-V3 Technical Report Table 3; MMLU-Pro (EM); unit is not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- DROP · DeepSeek-V3 Technical Report Table 3; DROP (F1); unit is not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- ARC-Easy · DeepSeek-V3 Technical Report Table 3; ARC-Easy (EM); unit is not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- ARC-Challenge · DeepSeek-V3 Technical Report Table 3; ARC-Challenge (EM); unit is not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- HellaSwag · DeepSeek-V3 Technical Report Table 3; HellaSwag (EM); unit is not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- PIQA · DeepSeek-V3 Technical Report Table 3; PIQA (EM); unit is not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- WinoGrande · DeepSeek-V3 Technical Report Table 3; WinoGrande (EM); unit is not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- RACE-Middle · DeepSeek-V3 Technical Report Table 3; RACE-Middle (EM); unit is not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- RACE-High · DeepSeek-V3 Technical Report Table 3; RACE-High (EM); unit is not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- TriviaQA · DeepSeek-V3 Technical Report Table 3; TriviaQA (EM); unit is not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- NaturalQuestions · DeepSeek-V3 Technical Report Table 3; NaturalQuestions (EM); unit is not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- AGIEval · DeepSeek-V3 Technical Report Table 3; AGIEval (EM); unit is not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- HumanEval · DeepSeek-V3 Technical Report Table 3; HumanEval (Pass@1); unit is not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- MBPP · DeepSeek-V3 Technical Report Table 3; MBPP (Pass@1); unit is not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- LiveCodeBench-Base · DeepSeek-V3 Technical Report Table 3; LiveCodeBench-Base 0801-1101 (Pass@1); unit is not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- CRUXEval-I · DeepSeek-V3 Technical Report Table 3; CRUXEval-I (EM); unit is not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- CRUXEval-O · DeepSeek-V3 Technical Report Table 3; CRUXEval-O (EM); unit is not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- GSM8K · DeepSeek-V3 Technical Report Table 3; GSM8K (EM); unit is not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- MATH · DeepSeek-V3 Technical Report Table 3; MATH (EM); unit is not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- MGSM · DeepSeek-V3 Technical Report Table 3; MGSM (EM); unit is not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- CMath · DeepSeek-V3 Technical Report Table 3; CMath (EM); unit is not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- CLUEWSC · DeepSeek-V3 Technical Report Table 3; CLUEWSC (EM); unit is not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- C-Eval · DeepSeek-V3 Technical Report Table 3; C-Eval (EM); unit is not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- CMMLU · DeepSeek-V3 Technical Report Table 3; CMMLU (EM); unit is not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- CMRC · DeepSeek-V3 Technical Report Table 3; CMRC (EM); unit is not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- C3 · DeepSeek-V3 Technical Report Table 3; C3 (EM); unit is not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- CCPM · DeepSeek-V3 Technical Report Table 3; CCPM (EM); unit is not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- MMMLU · DeepSeek-V3 Technical Report Table 3; MMMLU non-English (EM); unit is not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)