Claude Sonnet 5 · Real-World Finance(v2, 294 tasks) · 附件证据(ev5-real-world-finance)
Claude Sonnet 5 的 Real-World Finance · v2, 294 tasks 官方出处。见《Claude Sonnet 5 System Card》§8.11.2, PDF p.132。证据 ev5-real-world-finance。
原文与定位
Claude Sonnet 5 · Real-World Finance(v2, 294 tasks),Evaluation effort not specified配置,Elo rating 1219 Elo(具体成绩公布时间未确认)。见《Claude Sonnet 5 System Card》§8.11.2, PDF p.132。 查看成绩条件
Claude Sonnet 5 · Real-World Finance(v2, 294 tasks),Evaluation effort not specified配置,Head-to-head win rate 69%(具体成绩公布时间未确认)。见《Claude Sonnet 5 System Card》§8.11.2, PDF p.132。 查看成绩条件
The suite comprises 294 complex, realistic tasks representative of the day-to-day work of finance professionals. Because these tasks have open-ended deliverables rather than single correct answers, we evaluate them as pairwise comparisons: two models attempt the same task, and a model-based grader expresses a preference between the two work products. We report head-to-head win rates (and Elo derived from them), an approach similar to other published evaluations of professional work products. Sonnet 5 (1219) is statistically tied with Opus 4.7 (1207) and Opus 4.8 (1222), +219 over Sonnet 4.6 (Sonnet 5 wins 69% vs. Sonnet 4.6), and clearly below Fable 5 (Fable wins 69% vs. Sonnet 5).
- 官方材料
- Claude Sonnet 5 System Card · PDF 第 132 页
- 定位
- 附件 · §8.11.2, PDF p.132
- 材料版本
- PDF with changelog dated 2026-07-10; 146 pages; collected 2026-11-10
- 版本公布
- 未确认
- 披露时间
- 未确认 · 首发/后补未确认
- 采集时间
- 历史依据
- 暂无可靠历史版本依据
引用文本
Claude Sonnet 5 · Real-World Finance(v2, 294 tasks),Evaluation effort not specified配置,Elo rating 1219 Elo(具体成绩公布时间未确认);Claude Sonnet 5 · Real-World Finance(v2, 294 tasks),Evaluation effort not specified配置,Head-to-head win rate 69%(具体成绩公布时间未确认)。官方出处 Claude Sonnet 5 System Card(附件,PDF with changelog dated 2026-07-10; 146 pages; collected 2026-11-10)§8.11.2, PDF p.132,https://www.anthropic.com/claude-sonnet-5-system-card#page=132。Benchlog https://benchlog.lekshome.cc/evidence/claude-sonnet-5/ev5-real-world-finance/
关联成绩与条件
| 指标与成绩 | 配置与评测条件 | 证据关系 |
|---|---|---|
| Elo rating1219 Elo原文 1219 Elo · 单位 Elo 公布 未确认 | Evaluation effort not specified
| 直接支持该成绩 在排名中查看此成绩 |
| Head-to-head win rate69%原文 69% wins vs Sonnet 4.6 · 单位 % 公布 未确认 | Evaluation effort not specified
| 直接支持该成绩 在排名中查看此成绩 |