Claude Haiku 5.5 · PhysicianBench · 100 physician tasks in an electronic health record; pass rate across attempts · 成绩与配置

Claude Haiku 5.5 的 PhysicianBench · 100 physician tasks in an electronic health record; pass rate across attempts 记录。本次发布有 5 条成绩记录,含 5 条精确值(可含历史记录),附 1 条来源定位。

成绩与评测条件

Claude Haiku 5.5 · PhysicianBench 成绩与配置
指标与成绩配置与评测条件出处
Pass rate17.8%原文 17.8% · 单位 %
公布 未确认
Healthcare evaluations / low
设置
Safety classifiers enabled; low effort; run counts, scoring variants, and dates are recorded per result.
未知项
Healthcare evaluations use benchmark-specific run counts and scoring variants.
工具
工具条件未记录
推理预算
low
框架
未记录
协议
PhysicianBench; five attempts per task at each effort level.
条件
low effort; safety classifiers enabled. Low through xhigh runs were made October 5; max runs were made October 1-2. Max score was also reported in §8.11.2. Labeled figure value.
在排名中查看此成绩
Pass rate25.2%原文 25.2% · 单位 %
公布 未确认
Healthcare evaluations / medium
设置
Safety classifiers enabled; medium effort; run counts, scoring variants, and dates are recorded per result.
未知项
Healthcare evaluations use benchmark-specific run counts and scoring variants.
工具
工具条件未记录
推理预算
medium
框架
未记录
协议
PhysicianBench; five attempts per task at each effort level.
条件
medium effort; safety classifiers enabled. Low through xhigh runs were made October 5; max runs were made October 1-2. Max score was also reported in §8.11.2. Labeled figure value.
在排名中查看此成绩
Pass rate31.6%原文 31.6% · 单位 %
公布 未确认
Healthcare evaluations / high
设置
Safety classifiers enabled; high effort; run counts, scoring variants, and dates are recorded per result.
未知项
Healthcare evaluations use benchmark-specific run counts and scoring variants.
工具
工具条件未记录
推理预算
high
框架
未记录
协议
PhysicianBench; five attempts per task at each effort level.
条件
high effort; safety classifiers enabled. Low through xhigh runs were made October 5; max runs were made October 1-2. Max score was also reported in §8.11.2. Labeled figure value.
在排名中查看此成绩
Pass rate35.8%原文 35.8% · 单位 %
公布 未确认
Healthcare evaluations / xhigh
设置
Safety classifiers enabled; xhigh effort; run counts, scoring variants, and dates are recorded per result.
未知项
Healthcare evaluations use benchmark-specific run counts and scoring variants.
工具
工具条件未记录
推理预算
xhigh
框架
未记录
协议
PhysicianBench; five attempts per task at each effort level.
条件
xhigh effort; safety classifiers enabled. Low through xhigh runs were made October 5; max runs were made October 1-2. Max score was also reported in §8.11.2. Labeled figure value.
在排名中查看此成绩
Pass rate43%原文 43.0% · 单位 %
公布 未确认
Healthcare evaluations / max
设置
Safety classifiers enabled; max effort; run counts, scoring variants, and dates are recorded per result.
未知项
Healthcare evaluations use benchmark-specific run counts and scoring variants.
工具
工具条件未记录
推理预算
max
框架
未记录
协议
PhysicianBench; five attempts per task at each effort level.
条件
max effort; safety classifiers enabled. Low through xhigh runs were made October 5; max runs were made October 1-2. Max score was also reported in §8.11.2. Labeled figure value.
在排名中查看此成绩

出处与披露

测试版本与指标

别名 PhysicianBench

  • Pass rate · % · 越高越好