GPT-6.1 Sol · Factual error rate on difficult prompts · Internal error-inducing prompts in the GPT-6.1 Terra comparison article; exact dataset version, sample size and user-flagged provenance unspecified. · 成绩与配置

GPT-6.1 Sol 的 Factual error rate on difficult prompts · Internal error-inducing prompts in the GPT-6.1 Terra comparison article; exact dataset version, sample size and user-flagged provenance unspecified. 记录。本次发布有 5 条成绩记录,含 5 条精确值(可含历史记录),附 5 条来源定位。

成绩与评测条件

GPT-6.1 Sol · Factual error rate on difficult prompts 成绩与配置
指标与成绩配置与评测条件出处
Responses with at least one factual error14.7%原文 14.7% · 单位 %
公布
GPT-6.1 Sol low
设置
GPT-6.1 Sol; reasoning effort low as directly labeled in the official chart.
未知项
未另记
工具
工具条件未记录
推理预算
low
框架
未记录
协议
Factual error rate on difficult prompts (lower is better); y metric Answers with any factual error; x axis Cost (USD). Lower is better; article describes an internal benchmark of error-inducing prompts without identifying the user-flagged dataset.
条件
GPT-6.1 Sol; reasoning effort Low; chart cost $0.048.
在排名中查看此成绩
Responses with at least one factual error12%原文 12.0% · 单位 %
公布
GPT-6.1 Sol medium
设置
GPT-6.1 Sol; reasoning effort medium as directly labeled in the official chart.
未知项
未另记
工具
工具条件未记录
推理预算
medium
框架
未记录
协议
Factual error rate on difficult prompts (lower is better); y metric Answers with any factual error; x axis Cost (USD). Lower is better; article describes an internal benchmark of error-inducing prompts without identifying the user-flagged dataset.
条件
GPT-6.1 Sol; reasoning effort Medium; chart cost $0.056.
在排名中查看此成绩
Responses with at least one factual error6.6%原文 6.6% · 单位 %
公布
GPT-6.1 Sol high
设置
GPT-6.1 Sol; reasoning effort high as directly labeled in the official chart.
未知项
未另记
工具
工具条件未记录
推理预算
high
框架
未记录
协议
Factual error rate on difficult prompts (lower is better); y metric Answers with any factual error; x axis Cost (USD). Lower is better; article describes an internal benchmark of error-inducing prompts without identifying the user-flagged dataset.
条件
GPT-6.1 Sol; reasoning effort High; chart cost $0.079.
在排名中查看此成绩
Responses with at least one factual error5.5%原文 5.5% · 单位 %
公布
GPT-6.1 Sol xhigh
设置
GPT-6.1 Sol; reasoning effort xhigh as directly labeled in the official chart.
未知项
未另记
工具
工具条件未记录
推理预算
xhigh
框架
未记录
协议
Factual error rate on difficult prompts (lower is better); y metric Answers with any factual error; x axis Cost (USD). Lower is better; article describes an internal benchmark of error-inducing prompts without identifying the user-flagged dataset.
条件
GPT-6.1 Sol; reasoning effort Xhigh; chart cost $0.099.
在排名中查看此成绩
Responses with at least one factual error4.4%原文 4.4% · 单位 %
公布
GPT-6.1 Sol max
设置
GPT-6.1 Sol; reasoning effort max as directly labeled in the official chart.
未知项
未另记
工具
工具条件未记录
推理预算
max
框架
未记录
协议
Factual error rate on difficult prompts (lower is better); y metric Answers with any factual error; x axis Cost (USD). Lower is better; article describes an internal benchmark of error-inducing prompts without identifying the user-flagged dataset.
条件
GPT-6.1 Sol; reasoning effort Max; chart cost $0.12.
在排名中查看此成绩

出处与披露

测试版本与指标

别名 Factual error rate on difficult prompts (lower is better)

  • Responses with at least one factual error · % · 越低越好