GPT Terra · Factual error rate on difficult prompts · Internal error-inducing prompts in the GPT-6.1 Terra comparison article; exact dataset version, sample size and user-flagged provenance unspecified. · 历代记录
按发布时间查看 GPT Terra 的 2 次发布在 Factual error rate on difficult prompts · Internal error-inducing prompts in the GPT-6.1 Terra comparison article; exact dataset version, sample size and user-flagged provenance unspecified. 的成绩、配置与披露。
GPT-5.6 Terra · Factual error rate on difficult prompts 成绩与配置
指标与成绩
配置与评测条件
出处
Responses with at least one factual error53.6%原文 53.6% · 单位 %
公布
GPT-5.6 Terra low
设置
GPT-5.6 Terra; reasoning effort low, directly labeled in the official chart.
未知项
Sampling and harness settings are not stated for this chart.
工具
工具条件未记录
推理预算
low
框架
未记录
协议
Factual error rate on difficult prompts (lower is better); y metric Answers with any factual error; x axis Cost (USD). Lower is better; article describes an internal benchmark of error-inducing prompts without identifying the user-flagged dataset.
Responses with at least one factual error51.5%原文 51.5% · 单位 %
公布
GPT-5.6 Terra medium
设置
GPT-5.6 Terra; reasoning effort medium, directly labeled in the official chart.
未知项
Sampling and harness settings are not stated for this chart.
工具
工具条件未记录
推理预算
medium
框架
未记录
协议
Factual error rate on difficult prompts (lower is better); y metric Answers with any factual error; x axis Cost (USD). Lower is better; article describes an internal benchmark of error-inducing prompts without identifying the user-flagged dataset.
Responses with at least one factual error41.1%原文 41.1% · 单位 %
公布
GPT-5.6 Terra high
设置
GPT-5.6 Terra; reasoning effort high, directly labeled in the official chart.
未知项
Sampling and harness settings are not stated for this chart.
工具
工具条件未记录
推理预算
high
框架
未记录
协议
Factual error rate on difficult prompts (lower is better); y metric Answers with any factual error; x axis Cost (USD). Lower is better; article describes an internal benchmark of error-inducing prompts without identifying the user-flagged dataset.
Responses with at least one factual error33.9%原文 33.9% · 单位 %
公布
GPT-5.6 Terra xhigh
设置
GPT-5.6 Terra; reasoning effort xhigh, directly labeled in the official chart.
未知项
Sampling and harness settings are not stated for this chart.
工具
工具条件未记录
推理预算
xhigh
框架
未记录
协议
Factual error rate on difficult prompts (lower is better); y metric Answers with any factual error; x axis Cost (USD). Lower is better; article describes an internal benchmark of error-inducing prompts without identifying the user-flagged dataset.
Responses with at least one factual error22.3%原文 22.3% · 单位 %
公布
GPT-5.6 Terra max
设置
GPT-5.6 Terra; reasoning effort max, directly labeled in the official chart.
未知项
Sampling and harness settings are not stated for this chart.
工具
工具条件未记录
推理预算
max
框架
未记录
协议
Factual error rate on difficult prompts (lower is better); y metric Answers with any factual error; x axis Cost (USD). Lower is better; article describes an internal benchmark of error-inducing prompts without identifying the user-flagged dataset.
GPT-6.1 Terra · Factual error rate on difficult prompts 成绩与配置
指标与成绩
配置与评测条件
出处
Responses with at least one factual error16.7%原文 16.7% · 单位 %
公布 未确认
GPT-6.1 Terra low
设置
GPT-6.1 Terra; reasoning effort low, directly labeled in the official chart.
未知项
Sampling and harness settings are not stated for this chart.
工具
工具条件未记录
推理预算
low
框架
未记录
协议
Factual error rate on difficult prompts (lower is better); y metric Answers with any factual error; x axis Cost (USD). Lower is better; article describes an internal benchmark of error-inducing prompts without identifying the user-flagged dataset.
Responses with at least one factual error10.1%原文 10.1% · 单位 %
公布 未确认
GPT-6.1 Terra medium
设置
GPT-6.1 Terra; reasoning effort medium, directly labeled in the official chart.
未知项
Sampling and harness settings are not stated for this chart.
工具
工具条件未记录
推理预算
medium
框架
未记录
协议
Factual error rate on difficult prompts (lower is better); y metric Answers with any factual error; x axis Cost (USD). Lower is better; article describes an internal benchmark of error-inducing prompts without identifying the user-flagged dataset.
Responses with at least one factual error7.7%原文 7.7% · 单位 %
公布 未确认
GPT-6.1 Terra high
设置
GPT-6.1 Terra; reasoning effort high, directly labeled in the official chart.
未知项
Sampling and harness settings are not stated for this chart.
工具
工具条件未记录
推理预算
high
框架
未记录
协议
Factual error rate on difficult prompts (lower is better); y metric Answers with any factual error; x axis Cost (USD). Lower is better; article describes an internal benchmark of error-inducing prompts without identifying the user-flagged dataset.
Responses with at least one factual error5%原文 5.0% · 单位 %
公布 未确认
GPT-6.1 Terra xhigh
设置
GPT-6.1 Terra; reasoning effort xhigh, directly labeled in the official chart.
未知项
Sampling and harness settings are not stated for this chart.
工具
工具条件未记录
推理预算
xhigh
框架
未记录
协议
Factual error rate on difficult prompts (lower is better); y metric Answers with any factual error; x axis Cost (USD). Lower is better; article describes an internal benchmark of error-inducing prompts without identifying the user-flagged dataset.
Responses with at least one factual error4.3%原文 4.3% · 单位 %
公布 未确认
GPT-6.1 Terra max
设置
GPT-6.1 Terra at maximum reasoning effort, as stated in the release article for Terminal-Bench 4.0.
未知项
Other sampling and harness settings are not disclosed in the release article.
工具
工具条件未记录
推理预算
maximum
框架
未记录
协议
Factual error rate on difficult prompts (lower is better); y metric Answers with any factual error; x axis Cost (USD). Lower is better; article describes an internal benchmark of error-inducing prompts without identifying the user-flagged dataset.
GPT Terra · Factual error rate on difficult prompts · Internal error-inducing prompts in the GPT-6.1 Terra comparison article; exact dataset version, sample size and user-flagged provenance unspecified. · Release history
View scores, configurations, and disclosures for Factual error rate on difficult prompts · Internal error-inducing prompts in the GPT-6.1 Terra comparison article; exact dataset version, sample size and user-flagged provenance unspecified. across 2 GPT Terra releases, ordered by release date.
Differences are calculated only for unique, active, exact values between direct predecessors when the unit, metric, and explicitly recorded configuration and conditions match.
· 5 score records for this release, including 5 exact values (may include historical records)
GPT-5.6 Terra · Factual error rate on difficult prompts scores and configurations
Metric and score
Configuration and evaluation conditions
Sources
Responses with at least one factual error53.6%Reported 53.6% · Unit %
Published
GPT-5.6 Terra low
Settings
GPT-5.6 Terra; reasoning effort low, directly labeled in the official chart.
Unknowns
Sampling and harness settings are not stated for this chart.
Tools
Tool access not recorded
Reasoning budget
low
Framework
not recorded
Protocol
Factual error rate on difficult prompts (lower is better); y metric Answers with any factual error; x axis Cost (USD). Lower is better; article describes an internal benchmark of error-inducing prompts without identifying the user-flagged dataset.
Responses with at least one factual error51.5%Reported 51.5% · Unit %
Published
GPT-5.6 Terra medium
Settings
GPT-5.6 Terra; reasoning effort medium, directly labeled in the official chart.
Unknowns
Sampling and harness settings are not stated for this chart.
Tools
Tool access not recorded
Reasoning budget
medium
Framework
not recorded
Protocol
Factual error rate on difficult prompts (lower is better); y metric Answers with any factual error; x axis Cost (USD). Lower is better; article describes an internal benchmark of error-inducing prompts without identifying the user-flagged dataset.
Responses with at least one factual error41.1%Reported 41.1% · Unit %
Published
GPT-5.6 Terra high
Settings
GPT-5.6 Terra; reasoning effort high, directly labeled in the official chart.
Unknowns
Sampling and harness settings are not stated for this chart.
Tools
Tool access not recorded
Reasoning budget
high
Framework
not recorded
Protocol
Factual error rate on difficult prompts (lower is better); y metric Answers with any factual error; x axis Cost (USD). Lower is better; article describes an internal benchmark of error-inducing prompts without identifying the user-flagged dataset.
Responses with at least one factual error33.9%Reported 33.9% · Unit %
Published
GPT-5.6 Terra xhigh
Settings
GPT-5.6 Terra; reasoning effort xhigh, directly labeled in the official chart.
Unknowns
Sampling and harness settings are not stated for this chart.
Tools
Tool access not recorded
Reasoning budget
xhigh
Framework
not recorded
Protocol
Factual error rate on difficult prompts (lower is better); y metric Answers with any factual error; x axis Cost (USD). Lower is better; article describes an internal benchmark of error-inducing prompts without identifying the user-flagged dataset.
Responses with at least one factual error22.3%Reported 22.3% · Unit %
Published
GPT-5.6 Terra max
Settings
GPT-5.6 Terra; reasoning effort max, directly labeled in the official chart.
Unknowns
Sampling and harness settings are not stated for this chart.
Tools
Tool access not recorded
Reasoning budget
max
Framework
not recorded
Protocol
Factual error rate on difficult prompts (lower is better); y metric Answers with any factual error; x axis Cost (USD). Lower is better; article describes an internal benchmark of error-inducing prompts without identifying the user-flagged dataset.
· 5 score records for this release, including 5 exact values (may include historical records)
Records for the direct predecessor do not provide matching conditions for a valid difference.
GPT-6.1 Terra · Factual error rate on difficult prompts scores and configurations
Metric and score
Configuration and evaluation conditions
Sources
Responses with at least one factual error16.7%Reported 16.7% · Unit %
Published Unconfirmed
GPT-6.1 Terra low
Settings
GPT-6.1 Terra; reasoning effort low, directly labeled in the official chart.
Unknowns
Sampling and harness settings are not stated for this chart.
Tools
Tool access not recorded
Reasoning budget
low
Framework
not recorded
Protocol
Factual error rate on difficult prompts (lower is better); y metric Answers with any factual error; x axis Cost (USD). Lower is better; article describes an internal benchmark of error-inducing prompts without identifying the user-flagged dataset.
Responses with at least one factual error10.1%Reported 10.1% · Unit %
Published Unconfirmed
GPT-6.1 Terra medium
Settings
GPT-6.1 Terra; reasoning effort medium, directly labeled in the official chart.
Unknowns
Sampling and harness settings are not stated for this chart.
Tools
Tool access not recorded
Reasoning budget
medium
Framework
not recorded
Protocol
Factual error rate on difficult prompts (lower is better); y metric Answers with any factual error; x axis Cost (USD). Lower is better; article describes an internal benchmark of error-inducing prompts without identifying the user-flagged dataset.
Responses with at least one factual error7.7%Reported 7.7% · Unit %
Published Unconfirmed
GPT-6.1 Terra high
Settings
GPT-6.1 Terra; reasoning effort high, directly labeled in the official chart.
Unknowns
Sampling and harness settings are not stated for this chart.
Tools
Tool access not recorded
Reasoning budget
high
Framework
not recorded
Protocol
Factual error rate on difficult prompts (lower is better); y metric Answers with any factual error; x axis Cost (USD). Lower is better; article describes an internal benchmark of error-inducing prompts without identifying the user-flagged dataset.
Responses with at least one factual error5%Reported 5.0% · Unit %
Published Unconfirmed
GPT-6.1 Terra xhigh
Settings
GPT-6.1 Terra; reasoning effort xhigh, directly labeled in the official chart.
Unknowns
Sampling and harness settings are not stated for this chart.
Tools
Tool access not recorded
Reasoning budget
xhigh
Framework
not recorded
Protocol
Factual error rate on difficult prompts (lower is better); y metric Answers with any factual error; x axis Cost (USD). Lower is better; article describes an internal benchmark of error-inducing prompts without identifying the user-flagged dataset.
Responses with at least one factual error4.3%Reported 4.3% · Unit %
Published Unconfirmed
GPT-6.1 Terra max
Settings
GPT-6.1 Terra at maximum reasoning effort, as stated in the release article for Terminal-Bench 4.0.
Unknowns
Other sampling and harness settings are not disclosed in the release article.
Tools
Tool access not recorded
Reasoning budget
maximum
Framework
not recorded
Protocol
Factual error rate on difficult prompts (lower is better); y metric Answers with any factual error; x axis Cost (USD). Lower is better; article describes an internal benchmark of error-inducing prompts without identifying the user-flagged dataset.