Human Difficult subset score49.4%原文 49.4% (Human Difficult) · 单位 %
公布 未确认
BioMysteryBench · max
设置
Card-wide default max effort; bash, file editor, and package managers; Human Solvable and Human Difficult subsets; multiple tasks are nonpublic/internal evaluations.
未知项
未另记
工具
允许工具
推理预算
max
框架
未记录
协议
BioMysteryBench Human Difficult subset.
条件
Card-wide default max effort; bash, file editor and package managers; six problems removed after external feedback.
Human Solvable subset score90.1%原文 90.1% (Human Solvable) · 单位 %
公布 未确认
BioMysteryBench · max
设置
Card-wide default max effort; bash, file editor, and package managers; Human Solvable and Human Difficult subsets; multiple tasks are nonpublic/internal evaluations.
未知项
未另记
工具
允许工具
推理预算
max
框架
未记录
协议
BioMysteryBench Human Solvable subset.
条件
Card-wide default max effort; bash, file editor and package managers; three problems removed after external feedback.
Claude Opus 5 · BioMysteryBench · 官方发布表列 Hard 与 human-solved 结果;细分版本未注明 · Scores and configurations
Claude Opus 5 record for BioMysteryBench · 官方发布表列 Hard 与 human-solved 结果;细分版本未注明. 2 score records for this release, including 2 exact values (may include historical records). Includes 2 source locations.
Claude Opus 5 · BioMysteryBench scores and configurations
Metric and score
Configuration and evaluation conditions
Sources
Human Difficult subset score49.4%Reported 49.4% (Human Difficult) · Unit %
Published Unconfirmed
BioMysteryBench · max
Settings
Card-wide default max effort; bash, file editor, and package managers; Human Solvable and Human Difficult subsets; multiple tasks are nonpublic/internal evaluations.
Unknowns
none recorded
Tools
Tools allowed
Reasoning budget
max
Framework
not recorded
Protocol
BioMysteryBench Human Difficult subset.
Conditions
Card-wide default max effort; bash, file editor and package managers; six problems removed after external feedback.
Human Solvable subset score90.1%Reported 90.1% (Human Solvable) · Unit %
Published Unconfirmed
BioMysteryBench · max
Settings
Card-wide default max effort; bash, file editor, and package managers; Human Solvable and Human Difficult subsets; multiple tasks are nonpublic/internal evaluations.
Unknowns
none recorded
Tools
Tools allowed
Reasoning budget
max
Framework
not recorded
Protocol
BioMysteryBench Human Solvable subset.
Conditions
Card-wide default max effort; bash, file editor and package managers; three problems removed after external feedback.