工具条件未记录 / max / 框架未记录 · OfficeQA Pro; 133-question subset; agentic evaluation with source documents preselected as extracted text; mean of five runs.
OfficeQA · Pro 133-question subset · Exact-match accuracy · 工具条件未记录 / max / 框架未记录 · OfficeQA Pro; 133-question subset; agentic evaluation with source documents preselected as extracted text; mean of five runs.
允许工具 / max / 框架未记录 · OfficeQA Pro 133-question subset; max effort; mean over five runs; extracted Treasury Bulletin text in sandbox with code execution.
OfficeQA · Pro 133-question subset · Exact-match accuracy · 允许工具 / max / 框架未记录 · OfficeQA Pro 133-question subset; max effort; mean over five runs; extracted Treasury Bulletin text in sandbox with code execution.
Regular display scope. Rankings are grouped by metric and evaluation protocol. Recorded tool access, budgets, and frameworks are shown separately. Scores remain available for reference when conditions are unspecified.
Exact-match accuracy %
Tool access not recorded / max / Framework not recorded · OfficeQA Pro 133-question subset;agentic evaluation;max effort; mean of five runs.
OfficeQA · Pro 133-question subset · Exact-match accuracy · Tool access not recorded / max / Framework not recorded · OfficeQA Pro 133-question subset;agentic evaluation;max effort; mean of five runs.
Tool access not recorded / max / Framework not recorded · OfficeQA Pro; 133-question subset; agentic evaluation with source documents preselected as extracted text; mean of five runs.
OfficeQA · Pro 133-question subset · Exact-match accuracy · Tool access not recorded / max / Framework not recorded · OfficeQA Pro; 133-question subset; agentic evaluation with source documents preselected as extracted text; mean of five runs.
Tool access not recorded / max / Framework not recorded · OfficeQA Pro 133-question subset; exact-match accuracy.
OfficeQA · Pro 133-question subset · Exact-match accuracy · Tool access not recorded / max / Framework not recorded · OfficeQA Pro 133-question subset; exact-match accuracy.
Tools allowed / max / Framework not recorded · OfficeQA Pro 133-question subset; max effort; mean over five runs; extracted Treasury Bulletin text in sandbox with code execution.
OfficeQA · Pro 133-question subset · Exact-match accuracy · Tools allowed / max / Framework not recorded · OfficeQA Pro 133-question subset; max effort; mean over five runs; extracted Treasury Bulletin text in sandbox with code execution.