The Table 8.1.A Harbor result; the card-wide default is adaptive thinking at max effort, default sampling, and five trials unless noted. Harness-specific details for the Harbor row are not stated.
未知项
Do not merge with the distinct Anthropic mini-SWE-agent/GKE run in §8.5.
工具
工具条件未记录
推理预算
max
框架
Harbor
协议
FrontierBench v0.1; Harbor evaluation in Table 8.1.A; distinct from the Anthropic mini-SWE-agent/GKE run in §8.5.
条件
43.3%; Table 8.1.A attributes this row to Harbor. Card-wide default max effort/default sampling/five trials applies unless noted; the Harbor row does not state its harness details.
Anthropic-run mini-SWE-agent harness on GKE; mean reward over five attempts for each of 74 unique tasks; production safety classifiers were enabled. Refusals triggered fallback to Opus 4.8 in 4% of total trials. Explicit adaptive-thinking effort: low.
未知项
The card does not state any additional sampling parameters beyond the cited evaluation description.
工具
工具条件未记录
推理预算
low
框架
mini-SWE-agent harness
协议
FrontierBench v0.1; Anthropic mini-SWE-agent harness on GKE; mean reward over 74 tasks, five attempts each.
条件
Internal harness run separate from the Harbor Table 8.1.A row; max was reported as similar to xhigh and within noise. Safety classifiers/fallback were active.
FrontierBench v0.1 · mini-SWE-agent/GKE · High effort
设置
Anthropic-run mini-SWE-agent harness on GKE; mean reward over five attempts for each of 74 unique tasks; production safety classifiers were enabled. Refusals triggered fallback to Opus 4.8 in 4% of total trials. Explicit adaptive-thinking effort: high.
未知项
The card does not state any additional sampling parameters beyond the cited evaluation description.
工具
工具条件未记录
推理预算
high
框架
mini-SWE-agent harness
协议
FrontierBench v0.1; Anthropic mini-SWE-agent harness on GKE; mean reward over 74 tasks, five attempts each.
条件
Internal harness run separate from the Harbor Table 8.1.A row; max was reported as similar to xhigh and within noise. Safety classifiers/fallback were active.
Anthropic-run mini-SWE-agent harness on GKE; mean reward over five attempts for each of 74 unique tasks; production safety classifiers were enabled. Refusals triggered fallback to Opus 4.8 in 4% of total trials. Explicit adaptive-thinking effort: xhigh.
未知项
The card does not state any additional sampling parameters beyond the cited evaluation description.
工具
工具条件未记录
推理预算
xhigh
框架
mini-SWE-agent harness
协议
FrontierBench v0.1; Anthropic mini-SWE-agent harness on GKE; mean reward over 74 tasks, five attempts each.
条件
Internal harness run separate from the Harbor Table 8.1.A row; max was reported as similar to xhigh and within noise. Safety classifiers/fallback were active.
FrontierBench v0.1 · mini-SWE-agent/GKE · Max effort
设置
Anthropic-run mini-SWE-agent harness on GKE; mean reward over five attempts for each of 74 unique tasks; production safety classifiers were enabled. Refusals triggered fallback to Opus 4.8 in 4% of total trials. Explicit adaptive-thinking effort: max.
未知项
The card does not state any additional sampling parameters beyond the cited evaluation description.
工具
工具条件未记录
推理预算
max
框架
mini-SWE-agent harness
协议
FrontierBench v0.1; Anthropic mini-SWE-agent harness on GKE; mean reward over 74 tasks, five attempts each.
条件
Internal harness run separate from the Harbor Table 8.1.A row; max was reported as similar to xhigh and within noise. Safety classifiers/fallback were active.
Claude Opus 5 · Frontier-Bench · v0.1 · Scores and configurations
Claude Opus 5 record for Frontier-Bench · v0.1. 5 score records for this release, including 5 exact values (may include historical records). Includes 3 source locations.
Claude Opus 5 · Frontier-Bench scores and configurations
Metric and score
Configuration and evaluation conditions
Sources
Score43.3%Reported 43.3% · Unit %
Published Unconfirmed
FrontierBench v0.1 · Harbor evaluation
Settings
The Table 8.1.A Harbor result; the card-wide default is adaptive thinking at max effort, default sampling, and five trials unless noted. Harness-specific details for the Harbor row are not stated.
Unknowns
Do not merge with the distinct Anthropic mini-SWE-agent/GKE run in §8.5.
Tools
Tool access not recorded
Reasoning budget
max
Framework
Harbor
Protocol
FrontierBench v0.1; Harbor evaluation in Table 8.1.A; distinct from the Anthropic mini-SWE-agent/GKE run in §8.5.
Conditions
43.3%; Table 8.1.A attributes this row to Harbor. Card-wide default max effort/default sampling/five trials applies unless noted; the Harbor row does not state its harness details.
Anthropic-run mini-SWE-agent harness on GKE; mean reward over five attempts for each of 74 unique tasks; production safety classifiers were enabled. Refusals triggered fallback to Opus 4.8 in 4% of total trials. Explicit adaptive-thinking effort: low.
Unknowns
The card does not state any additional sampling parameters beyond the cited evaluation description.
Tools
Tool access not recorded
Reasoning budget
low
Framework
mini-SWE-agent harness
Protocol
FrontierBench v0.1; Anthropic mini-SWE-agent harness on GKE; mean reward over 74 tasks, five attempts each.
Conditions
Internal harness run separate from the Harbor Table 8.1.A row; max was reported as similar to xhigh and within noise. Safety classifiers/fallback were active.
FrontierBench v0.1 · mini-SWE-agent/GKE · High effort
Settings
Anthropic-run mini-SWE-agent harness on GKE; mean reward over five attempts for each of 74 unique tasks; production safety classifiers were enabled. Refusals triggered fallback to Opus 4.8 in 4% of total trials. Explicit adaptive-thinking effort: high.
Unknowns
The card does not state any additional sampling parameters beyond the cited evaluation description.
Tools
Tool access not recorded
Reasoning budget
high
Framework
mini-SWE-agent harness
Protocol
FrontierBench v0.1; Anthropic mini-SWE-agent harness on GKE; mean reward over 74 tasks, five attempts each.
Conditions
Internal harness run separate from the Harbor Table 8.1.A row; max was reported as similar to xhigh and within noise. Safety classifiers/fallback were active.
Anthropic-run mini-SWE-agent harness on GKE; mean reward over five attempts for each of 74 unique tasks; production safety classifiers were enabled. Refusals triggered fallback to Opus 4.8 in 4% of total trials. Explicit adaptive-thinking effort: xhigh.
Unknowns
The card does not state any additional sampling parameters beyond the cited evaluation description.
Tools
Tool access not recorded
Reasoning budget
xhigh
Framework
mini-SWE-agent harness
Protocol
FrontierBench v0.1; Anthropic mini-SWE-agent harness on GKE; mean reward over 74 tasks, five attempts each.
Conditions
Internal harness run separate from the Harbor Table 8.1.A row; max was reported as similar to xhigh and within noise. Safety classifiers/fallback were active.
FrontierBench v0.1 · mini-SWE-agent/GKE · Max effort
Settings
Anthropic-run mini-SWE-agent harness on GKE; mean reward over five attempts for each of 74 unique tasks; production safety classifiers were enabled. Refusals triggered fallback to Opus 4.8 in 4% of total trials. Explicit adaptive-thinking effort: max.
Unknowns
The card does not state any additional sampling parameters beyond the cited evaluation description.
Tools
Tool access not recorded
Reasoning budget
max
Framework
mini-SWE-agent harness
Protocol
FrontierBench v0.1; Anthropic mini-SWE-agent harness on GKE; mean reward over 74 tasks, five attempts each.
Conditions
Internal harness run separate from the Harbor Table 8.1.A row; max was reported as similar to xhigh and within noise. Safety classifiers/fallback were active.