Voxel IoU0.73原文 0.730 voxel IoU without tools · 单位 未标注
公布 未确认
BenchCAD Vision2Code max effort, no tools
设置
Adaptive thinking/max effort; corrected 256 x 256 px per view implementation; random 1,000-file subset; five runs.
未知项
Task-level variance is not separately reported in the card text.
工具
禁止工具
推理预算
max
框架
未记录
协议
BenchCAD Vision2Code; random 1,000-file subset of 17,900; adaptive thinking/max effort; corrected 256 x 256 px per view implementation; five runs; no tools.
条件
Replaces the earlier 128 x 128 px implementation for model comparisons; not expressed as percent accuracy. Source-wide conditions: Corrected intended implementation uses 256 x 256 px per view, four views; random 1,000-file subset; max effort; five runs. Earlier 128 x 128 px implementation is not comparable.
Voxel IoU0.962原文 0.962 voxel IoU with tools · 单位 未标注
公布 未确认
BenchCAD Vision2Code max effort, with tools
设置
Adaptive thinking/max effort; container, standard libraries, and image-cropping tool; corrected 256 x 256 px per view implementation; random 1,000-file subset; five runs.
未知项
Task-level variance is not separately reported in the card text.
工具
允许工具
推理预算
max
框架
未记录
协议
BenchCAD Vision2Code; random 1,000-file subset of 17,900; adaptive thinking/max effort; corrected 256 x 256 px per view implementation; container, libraries, and crop tool; five runs.
条件
Replaces the earlier 128 x 128 px implementation for model comparisons; not expressed as percent accuracy. Source-wide conditions: Corrected intended implementation uses 256 x 256 px per view, four views; random 1,000-file subset; max effort; five runs. Earlier 128 x 128 px implementation is not comparable.
Claude Opus · BenchCAD Vision2Code · 1,000-file random subset of 17,900 files · Release history
View scores, configurations, and disclosures for BenchCAD Vision2Code · 1,000-file random subset of 17,900 files across 2 Claude Opus releases, ordered by release date.
Differences are calculated only for unique, active, exact values between direct predecessors when the unit, metric, and explicitly recorded configuration and conditions match.
· 2 score records for this release, including 2 exact values (may include historical records)
Records for the direct predecessor do not provide matching conditions for a valid difference.
Claude Opus 5.5 · BenchCAD Vision2Code scores and configurations
Metric and score
Configuration and evaluation conditions
Sources
Voxel IoU0.73Reported 0.730 voxel IoU without tools · Unit not specified
Published Unconfirmed
BenchCAD Vision2Code max effort, no tools
Settings
Adaptive thinking/max effort; corrected 256 x 256 px per view implementation; random 1,000-file subset; five runs.
Unknowns
Task-level variance is not separately reported in the card text.
Tools
Tools forbidden
Reasoning budget
max
Framework
not recorded
Protocol
BenchCAD Vision2Code; random 1,000-file subset of 17,900; adaptive thinking/max effort; corrected 256 x 256 px per view implementation; five runs; no tools.
Conditions
Replaces the earlier 128 x 128 px implementation for model comparisons; not expressed as percent accuracy. Source-wide conditions: Corrected intended implementation uses 256 x 256 px per view, four views; random 1,000-file subset; max effort; five runs. Earlier 128 x 128 px implementation is not comparable.
Voxel IoU0.962Reported 0.962 voxel IoU with tools · Unit not specified
Published Unconfirmed
BenchCAD Vision2Code max effort, with tools
Settings
Adaptive thinking/max effort; container, standard libraries, and image-cropping tool; corrected 256 x 256 px per view implementation; random 1,000-file subset; five runs.
Unknowns
Task-level variance is not separately reported in the card text.
Tools
Tools allowed
Reasoning budget
max
Framework
not recorded
Protocol
BenchCAD Vision2Code; random 1,000-file subset of 17,900; adaptive thinking/max effort; corrected 256 x 256 px per view implementation; container, libraries, and crop tool; five runs.
Conditions
Replaces the earlier 128 x 128 px implementation for model comparisons; not expressed as percent accuracy. Source-wide conditions: Corrected intended implementation uses 256 x 256 px per view, four views; random 1,000-file subset; max effort; five runs. Earlier 128 x 128 px implementation is not comparable.