允许工具 / high / 框架未记录 · Single attempt; average over 10 runs; official provider method. Google adjusted the score by +0.6% after fixing three impossible official harness items.
SWE-bench Verified · Verified subset (500 problems) · Pass rate · 允许工具 / high / 框架未记录 · Single attempt; average over 10 runs; official provider method. Google adjusted the score by +0.6% after fixing three impossible official harness items.
Regular display scope. Rankings are grouped by metric and evaluation protocol. Recorded tool access, budgets, and frameworks are shown separately. Scores remain available for reference when conditions are unspecified.
Pass rate %
Tools allowed / high / Framework not recorded · Single attempt; average over 10 runs; official provider method. Google adjusted the score by +0.6% after fixing three impossible official harness items.
SWE-bench Verified · Verified subset (500 problems) · Pass rate · Tools allowed / high / Framework not recorded · Single attempt; average over 10 runs; official provider method. Google adjusted the score by +0.6% after fixing three impossible official harness items.
Tool access not recorded / Reasoning budget not recorded / OpenHands v0.34.0 · SWE-bench Verified; OpenHands v0.34.0; maximum 100 iterations; history truncation to stay within 128K; temperature=0.6; top_p=1.0.
SWE-bench Verified · Verified subset (500 problems) · Pass rate · Tool access not recorded / Reasoning budget not recorded / OpenHands v0.34.0 · SWE-bench Verified; OpenHands v0.34.0; maximum 100 iterations; history truncation to stay within 128K; temperature=0.6; top_p=1.0.