Home Model series Claude Sonnet Claude Sonnet 4.6 Claude Sonnet 4.6 · OpenRCA · 335 enterprise software failure cases · Scores and configurations Claude Sonnet 4.6 · OpenRCA · 335 enterprise software failure cases · Scores and configurations Claude Sonnet 4.6 record for OpenRCA · 335 enterprise software failure cases. 2 score records for this release, including 2 exact values (may include historical records). Includes 1 source location.
Scores and evaluation conditions Claude Sonnet 4.6 · OpenRCA scores and configurations Metric and score Configuration and evaluation conditions Sources Root-cause identification score 27.9% Reported 27.9% · Unit % Published Unconfirmed
Adaptive thinking, high effort Settings Adaptive thinking enabled; high effort. Unknowns Sampling settings are not specified in every evaluation. Tools Tool access not recorded Reasoning budget high Framework not recorded Protocol 335-case benchmark; author's agent harness; three-run average. Conditions Adaptive thinking, high effort. Scores range 0-100% and measure root-cause identification. View this score in rankings Root-cause identification score 26.4% Reported 26.4% · Unit % Published Unconfirmed
Adaptive thinking, max effort Settings Adaptive thinking enabled; max effort; default temperature and top_p unless an evaluation specifies otherwise. Unknowns Context window is evaluation-dependent; Table 2.1.A states it does not exceed 1M tokens. Tools Tool access not recorded Reasoning budget max Framework not recorded Protocol 335-case benchmark; author's agent harness; three-run average. Conditions Adaptive thinking, max effort. Separate configuration from the high-effort result. View this score in rankings
Benchmark versions and metrics Aliases OpenRCA
Root-cause identification score · % · Higher is better