Terminal-Bench 4.0; 66 tasks; ten trials per task (660 trials); Claude Code --bare at max thinking effort.
条件
Safeguards enabled without fallback; requests were flagged in 1.8% of trials (12/660), causing failure. No internet egress; historical resources were pre-cached. The card estimates this did not move the result outside noise but did not rigorously measure the effect.
Claude Haiku 5.5 · Terminal-Bench · 4.0 · Scores and configurations
Claude Haiku 5.5 record for Terminal-Bench · 4.0. 1 score record for this release, including 1 exact value (may include historical records). Includes 2 source locations.
Terminal-Bench 4.0; 66 tasks; ten trials per task (660 trials); Claude Code --bare at max thinking effort.
Conditions
Safeguards enabled without fallback; requests were flagged in 1.8% of trials (12/660), causing failure. No internet egress; historical resources were pre-cached. The card estimates this did not move the result outside noise but did not rigorously measure the effect.