Claude Sonnet 5 · Real-World Finance(v2, 294 tasks) · 附件证据(ev5-real-world-finance)

Claude Sonnet 5 的 Real-World Finance · v2, 294 tasks 官方出处。见《Claude Sonnet 5 System Card》§8.11.2, PDF p.132。证据 ev5-real-world-finance。

原文与定位

Claude Sonnet 5 · Real-World Finance(v2, 294 tasks),Evaluation effort not specified配置,Elo rating 1219 Elo(具体成绩公布时间未确认)。见《Claude Sonnet 5 System Card》§8.11.2, PDF p.132。 查看成绩条件

Claude Sonnet 5 · Real-World Finance(v2, 294 tasks),Evaluation effort not specified配置,Head-to-head win rate 69%(具体成绩公布时间未确认)。见《Claude Sonnet 5 System Card》§8.11.2, PDF p.132。 查看成绩条件

The suite comprises 294 complex, realistic tasks representative of the day-to-day work of finance professionals. Because these tasks have open-ended deliverables rather than single correct answers, we evaluate them as pairwise comparisons: two models attempt the same task, and a model-based grader expresses a preference between the two work products. We report head-to-head win rates (and Elo derived from them), an approach similar to other published evaluations of professional work products. Sonnet 5 (1219) is statistically tied with Opus 4.7 (1207) and Opus 4.8 (1222), +219 over Sonnet 4.6 (Sonnet 5 wins 69% vs. Sonnet 4.6), and clearly below Fable 5 (Fable wins 69% vs. Sonnet 5).
官方材料
Claude Sonnet 5 System Card · PDF 第 132 页
定位
附件 · §8.11.2, PDF p.132
材料版本
PDF with changelog dated 2026-07-10; 146 pages; collected 2026-11-10
版本公布
未确认
披露时间
未确认 · 首发/后补未确认
采集时间
历史依据
暂无可靠历史版本依据
引用文本

Claude Sonnet 5 · Real-World Finance(v2, 294 tasks),Evaluation effort not specified配置,Elo rating 1219 Elo(具体成绩公布时间未确认);Claude Sonnet 5 · Real-World Finance(v2, 294 tasks),Evaluation effort not specified配置,Head-to-head win rate 69%(具体成绩公布时间未确认)。官方出处 Claude Sonnet 5 System Card(附件,PDF with changelog dated 2026-07-10; 146 pages; collected 2026-11-10)§8.11.2, PDF p.132,https://www.anthropic.com/claude-sonnet-5-system-card#page=132。Benchlog https://benchlog.lekshome.cc/evidence/claude-sonnet-5/ev5-real-world-finance/

关联成绩与条件

Claude Sonnet 5 · Real-World Finance 成绩与配置
指标与成绩配置与评测条件证据关系
Elo rating1219 Elo原文 1219 Elo · 单位 Elo
公布 未确认
Evaluation effort not specified
设置
Only the setup explicitly named in the result's conditions is known.
未知项
Effort and sampling may be unknown; see each result.conditions.
工具
工具条件未记录
推理预算
未记录
框架
未记录
协议
Real-World Finance v2, 294 tasks; Elo derived from pairwise comparison of work products.
条件
Internal long-horizon finance evaluation. Effort settings are not stated in the scalar result paragraph.

直接支持该成绩

在排名中查看此成绩
Head-to-head win rate69%原文 69% wins vs Sonnet 4.6 · 单位 %
公布 未确认
Evaluation effort not specified
设置
Only the setup explicitly named in the result's conditions is known.
未知项
Effort and sampling may be unknown; see each result.conditions.
工具
工具条件未记录
推理预算
未记录
框架
未记录
协议
Real-World Finance v2 head-to-head comparison against Claude Sonnet 4.6.
条件
Same 294-task suite; report does not provide a confidence interval for this win rate in the text.

直接支持该成绩

在排名中查看此成绩