Computer Use API with browser tools for screenshot and DOM navigation; general-purpose prompts; one policy model; official grader; five independent runs.
未知项
Exact WebArena task release and task count are not stated.
工具
允许工具
推理预算
未记录
框架
未记录
协议
WebArena official grader; one policy model; five independent runs.
条件
Computer Use API with additional browser tools and general-purpose prompts; no website-specific prompt engineering.
Computer Use API with browser tools for screenshot and DOM navigation; general-purpose prompts; one policy model; official grader; five independent runs.
未知项
Exact WebArena task release and task count are not stated.
工具
允许工具
推理预算
未记录
框架
未记录
协议
WebArena official grader; Pass@2.
条件
Same single-policy, general-prompt Computer Use API setup; not directly comparable with single-attempt Pass@1.
Computer Use API with browser tools for screenshot and DOM navigation; general-purpose prompts; one policy model; official grader; five independent runs.
未知项
Exact WebArena task release and task count are not stated.
工具
允许工具
推理预算
未记录
框架
未记录
协议
WebArena official grader; Pass@3.
条件
Same single-policy, general-prompt Computer Use API setup; not directly comparable with single-attempt Pass@1.
Computer Use API with browser tools for screenshot and DOM navigation; general-purpose prompts; one policy model; official grader; five independent runs.
未知项
Exact WebArena task release and task count are not stated.
工具
允许工具
推理预算
未记录
框架
未记录
协议
WebArena official grader; Pass@4.
条件
Same single-policy, general-prompt Computer Use API setup; not directly comparable with single-attempt Pass@1.
Claude Opus 4.5 · WebArena · Official WebArena grader; exact task release/subset not stated in card · Scores and configurations
Claude Opus 4.5 record for WebArena · Official WebArena grader; exact task release/subset not stated in card. 4 score records for this release, including 4 exact values (may include historical records). Includes 1 source location.
Claude Opus 4.5 · WebArena scores and configurations
Metric and score
Configuration and evaluation conditions
Sources
Pass@165.3%Reported 65.3% · Unit %
Published Unconfirmed
WebArena single-policy evaluation
Settings
Computer Use API with browser tools for screenshot and DOM navigation; general-purpose prompts; one policy model; official grader; five independent runs.
Unknowns
Exact WebArena task release and task count are not stated.
Tools
Tools allowed
Reasoning budget
not recorded
Framework
not recorded
Protocol
WebArena official grader; one policy model; five independent runs.
Conditions
Computer Use API with additional browser tools and general-purpose prompts; no website-specific prompt engineering.
Computer Use API with browser tools for screenshot and DOM navigation; general-purpose prompts; one policy model; official grader; five independent runs.
Unknowns
Exact WebArena task release and task count are not stated.
Tools
Tools allowed
Reasoning budget
not recorded
Framework
not recorded
Protocol
WebArena official grader; Pass@2.
Conditions
Same single-policy, general-prompt Computer Use API setup; not directly comparable with single-attempt Pass@1.
Computer Use API with browser tools for screenshot and DOM navigation; general-purpose prompts; one policy model; official grader; five independent runs.
Unknowns
Exact WebArena task release and task count are not stated.
Tools
Tools allowed
Reasoning budget
not recorded
Framework
not recorded
Protocol
WebArena official grader; Pass@3.
Conditions
Same single-policy, general-prompt Computer Use API setup; not directly comparable with single-attempt Pass@1.
Computer Use API with browser tools for screenshot and DOM navigation; general-purpose prompts; one policy model; official grader; five independent runs.
Unknowns
Exact WebArena task release and task count are not stated.
Tools
Tools allowed
Reasoning budget
not recorded
Framework
not recorded
Protocol
WebArena official grader; Pass@4.
Conditions
Same single-policy, general-prompt Computer Use API setup; not directly comparable with single-attempt Pass@1.