Claude Haiku 5.5 · PhysicianBench · 100 physician tasks in an electronic health record; pass rate across attempts · 成绩与配置
Claude Haiku 5.5 的 PhysicianBench · 100 physician tasks in an electronic health record; pass rate across attempts 记录。本次发布有 5 条成绩记录,含 5 条精确值(可含历史记录),附 1 条来源定位。
Safety classifiers enabled; low effort; run counts, scoring variants, and dates are recorded per result.
未知项
Healthcare evaluations use benchmark-specific run counts and scoring variants.
工具
工具条件未记录
推理预算
low
框架
未记录
协议
PhysicianBench; five attempts per task at each effort level.
条件
low effort; safety classifiers enabled. Low through xhigh runs were made October 5; max runs were made October 1-2. Max score was also reported in §8.11.2. Labeled figure value.
Safety classifiers enabled; medium effort; run counts, scoring variants, and dates are recorded per result.
未知项
Healthcare evaluations use benchmark-specific run counts and scoring variants.
工具
工具条件未记录
推理预算
medium
框架
未记录
协议
PhysicianBench; five attempts per task at each effort level.
条件
medium effort; safety classifiers enabled. Low through xhigh runs were made October 5; max runs were made October 1-2. Max score was also reported in §8.11.2. Labeled figure value.
Safety classifiers enabled; high effort; run counts, scoring variants, and dates are recorded per result.
未知项
Healthcare evaluations use benchmark-specific run counts and scoring variants.
工具
工具条件未记录
推理预算
high
框架
未记录
协议
PhysicianBench; five attempts per task at each effort level.
条件
high effort; safety classifiers enabled. Low through xhigh runs were made October 5; max runs were made October 1-2. Max score was also reported in §8.11.2. Labeled figure value.
Safety classifiers enabled; xhigh effort; run counts, scoring variants, and dates are recorded per result.
未知项
Healthcare evaluations use benchmark-specific run counts and scoring variants.
工具
工具条件未记录
推理预算
xhigh
框架
未记录
协议
PhysicianBench; five attempts per task at each effort level.
条件
xhigh effort; safety classifiers enabled. Low through xhigh runs were made October 5; max runs were made October 1-2. Max score was also reported in §8.11.2. Labeled figure value.
Safety classifiers enabled; max effort; run counts, scoring variants, and dates are recorded per result.
未知项
Healthcare evaluations use benchmark-specific run counts and scoring variants.
工具
工具条件未记录
推理预算
max
框架
未记录
协议
PhysicianBench; five attempts per task at each effort level.
条件
max effort; safety classifiers enabled. Low through xhigh runs were made October 5; max runs were made October 1-2. Max score was also reported in §8.11.2. Labeled figure value.
Claude Haiku 5.5 · PhysicianBench · 100 physician tasks in an electronic health record; pass rate across attempts · Scores and configurations
Claude Haiku 5.5 record for PhysicianBench · 100 physician tasks in an electronic health record; pass rate across attempts. 5 score records for this release, including 5 exact values (may include historical records). Includes 1 source location.
Claude Haiku 5.5 · PhysicianBench scores and configurations
Metric and score
Configuration and evaluation conditions
Sources
Pass rate17.8%Reported 17.8% · Unit %
Published Unconfirmed
Healthcare evaluations / low
Settings
Safety classifiers enabled; low effort; run counts, scoring variants, and dates are recorded per result.
Unknowns
Healthcare evaluations use benchmark-specific run counts and scoring variants.
Tools
Tool access not recorded
Reasoning budget
low
Framework
not recorded
Protocol
PhysicianBench; five attempts per task at each effort level.
Conditions
low effort; safety classifiers enabled. Low through xhigh runs were made October 5; max runs were made October 1-2. Max score was also reported in §8.11.2. Labeled figure value.
Safety classifiers enabled; medium effort; run counts, scoring variants, and dates are recorded per result.
Unknowns
Healthcare evaluations use benchmark-specific run counts and scoring variants.
Tools
Tool access not recorded
Reasoning budget
medium
Framework
not recorded
Protocol
PhysicianBench; five attempts per task at each effort level.
Conditions
medium effort; safety classifiers enabled. Low through xhigh runs were made October 5; max runs were made October 1-2. Max score was also reported in §8.11.2. Labeled figure value.
Safety classifiers enabled; high effort; run counts, scoring variants, and dates are recorded per result.
Unknowns
Healthcare evaluations use benchmark-specific run counts and scoring variants.
Tools
Tool access not recorded
Reasoning budget
high
Framework
not recorded
Protocol
PhysicianBench; five attempts per task at each effort level.
Conditions
high effort; safety classifiers enabled. Low through xhigh runs were made October 5; max runs were made October 1-2. Max score was also reported in §8.11.2. Labeled figure value.
Safety classifiers enabled; xhigh effort; run counts, scoring variants, and dates are recorded per result.
Unknowns
Healthcare evaluations use benchmark-specific run counts and scoring variants.
Tools
Tool access not recorded
Reasoning budget
xhigh
Framework
not recorded
Protocol
PhysicianBench; five attempts per task at each effort level.
Conditions
xhigh effort; safety classifiers enabled. Low through xhigh runs were made October 5; max runs were made October 1-2. Max score was also reported in §8.11.2. Labeled figure value.
Safety classifiers enabled; max effort; run counts, scoring variants, and dates are recorded per result.
Unknowns
Healthcare evaluations use benchmark-specific run counts and scoring variants.
Tools
Tool access not recorded
Reasoning budget
max
Framework
not recorded
Protocol
PhysicianBench; five attempts per task at each effort level.
Conditions
max effort; safety classifiers enabled. Low through xhigh runs were made October 5; max runs were made October 1-2. Max score was also reported in §8.11.2. Labeled figure value.