Home Model series Gemini 4 Carbon Gemini 4 Carbon Gemini 4 Carbon · OSWorld · 2.1, 82-task offline no-internet subset, partial score · Scores and configurations Gemini 4 Carbon · OSWorld · 2.1, 82-task offline no-internet subset, partial score · Scores and configurations Gemini 4 Carbon record for OSWorld · 2.1, 82-task offline no-internet subset, partial score. 1 score record for this release, including 1 exact value (may include historical records). Includes 1 source location.
Scores and evaluation conditions Gemini 4 Carbon · OSWorld scores and configurations Metric and score Configuration and evaluation conditions Sources Partial score 81.5% Reported 81.5% · Unit % Published Unconfirmed
Gemini 4 Carbon highest thinking Settings Gemini API model gemini-4-carbon; highest thinking settings; default sampling unless benchmark method states otherwise; pass@1 except where stated. Unknowns Exact thinking budget and sampling parameters are not published.、原文仅称 highest thinking settings,未确认对应的公开档位名称。 Tools Tools allowed Reasoning budget not recorded Framework not recorded Protocol 82-task offline no-internet subset; max over 3 runs, one attempt each; official Docker/evaluator; 1080p, max 500 steps; Gemini CUA with batched calls. Conditions Reports partial score; benchmark method source notes screenshot-only observations and UI-specific function declarations. View this score in rankings
Benchmark versions and metrics Aliases OSWorld-2.1 offline subset
Partial score · % · Higher is better Strict pass rate · % · Higher is better