GPT-6 Astra · Factual error rate on difficult prompts 成绩与配置
指标与成绩
配置与评测条件
出处
Responses with at least one factual error13.3%原文 13.3% · 单位 %
公布 未确认
GPT-6 Astra low
设置
GPT-6 Astra; reasoning effort low as printed in the interactive chart.
未知项
未另记
工具
工具条件未记录
推理预算
low
框架
未记录
协议
Internal error-inducing difficult prompts; responses with any factual error; lower is better. Exact dataset, sample size and user-flagged provenance not stated in this source.
条件
Later GPT-6.1 Terra comparison article; GPT-6 Astra effort Low. Chart Cost: USD 0.26 per task; exact cost-accounting and sampling settings unspecified. All 143 chart points were cross-checked against official embedded values and rendered SVG labels. This result is attributed to Astra, not to the article's Terra subject; no launch qualification is inferred.
Responses with at least one factual error9.7%原文 9.7% · 单位 %
公布 未确认
GPT-6 Astra medium
设置
GPT-6 Astra; reasoning effort medium as printed in the interactive chart.
未知项
未另记
工具
工具条件未记录
推理预算
medium
框架
未记录
协议
Internal error-inducing difficult prompts; responses with any factual error; lower is better. Exact dataset, sample size and user-flagged provenance not stated in this source.
条件
Later GPT-6.1 Terra comparison article; GPT-6 Astra effort Medium. Chart Cost: USD 0.29 per task; exact cost-accounting and sampling settings unspecified. All 143 chart points were cross-checked against official embedded values and rendered SVG labels. This result is attributed to Astra, not to the article's Terra subject; no launch qualification is inferred.
Responses with at least one factual error5.9%原文 5.9% · 单位 %
公布 未确认
GPT-6 Astra high
设置
GPT-6 Astra; reasoning effort high as printed in the interactive chart.
未知项
未另记
工具
工具条件未记录
推理预算
high
框架
未记录
协议
Internal error-inducing difficult prompts; responses with any factual error; lower is better. Exact dataset, sample size and user-flagged provenance not stated in this source.
条件
Later GPT-6.1 Terra comparison article; GPT-6 Astra effort High. Chart Cost: USD 0.43 per task; exact cost-accounting and sampling settings unspecified. All 143 chart points were cross-checked against official embedded values and rendered SVG labels. This result is attributed to Astra, not to the article's Terra subject; no launch qualification is inferred.
Responses with at least one factual error4.6%原文 4.6% · 单位 %
公布 未确认
GPT-6 Astra xhigh
设置
GPT-6 Astra; reasoning effort xhigh as printed in the interactive chart.
未知项
未另记
工具
工具条件未记录
推理预算
xhigh
框架
未记录
协议
Internal error-inducing difficult prompts; responses with any factual error; lower is better. Exact dataset, sample size and user-flagged provenance not stated in this source.
条件
Later GPT-6.1 Terra comparison article; GPT-6 Astra effort Xhigh. Chart Cost: USD 0.55 per task; exact cost-accounting and sampling settings unspecified. All 143 chart points were cross-checked against official embedded values and rendered SVG labels. This result is attributed to Astra, not to the article's Terra subject; no launch qualification is inferred.
Responses with at least one factual error4.2%原文 4.2% · 单位 %
公布 未确认
GPT-6 Astra max
设置
GPT-6 Astra; reasoning effort max as printed in the interactive chart.
未知项
未另记
工具
工具条件未记录
推理预算
max
框架
未记录
协议
Internal error-inducing difficult prompts; responses with any factual error; lower is better. Exact dataset, sample size and user-flagged provenance not stated in this source.
条件
Later GPT-6.1 Terra comparison article; GPT-6 Astra effort Max. Chart Cost: USD 0.66 per task; exact cost-accounting and sampling settings unspecified. All 143 chart points were cross-checked against official embedded values and rendered SVG labels. This result is attributed to Astra, not to the article's Terra subject; no launch qualification is inferred.
GPT-6 Astra · Factual error rate on difficult prompts · Internal error-inducing prompts in the GPT-6.1 Terra comparison article; exact dataset version, sample size and user-flagged provenance unspecified. · Scores and configurations
GPT-6 Astra record for Factual error rate on difficult prompts · Internal error-inducing prompts in the GPT-6.1 Terra comparison article; exact dataset version, sample size and user-flagged provenance unspecified.. 5 score records for this release, including 5 exact values (may include historical records). Includes 5 source locations.
GPT-6 Astra · Factual error rate on difficult prompts scores and configurations
Metric and score
Configuration and evaluation conditions
Sources
Responses with at least one factual error13.3%Reported 13.3% · Unit %
Published Unconfirmed
GPT-6 Astra low
Settings
GPT-6 Astra; reasoning effort low as printed in the interactive chart.
Unknowns
none recorded
Tools
Tool access not recorded
Reasoning budget
low
Framework
not recorded
Protocol
Internal error-inducing difficult prompts; responses with any factual error; lower is better. Exact dataset, sample size and user-flagged provenance not stated in this source.
Conditions
Later GPT-6.1 Terra comparison article; GPT-6 Astra effort Low. Chart Cost: USD 0.26 per task; exact cost-accounting and sampling settings unspecified. All 143 chart points were cross-checked against official embedded values and rendered SVG labels. This result is attributed to Astra, not to the article's Terra subject; no launch qualification is inferred.
Responses with at least one factual error9.7%Reported 9.7% · Unit %
Published Unconfirmed
GPT-6 Astra medium
Settings
GPT-6 Astra; reasoning effort medium as printed in the interactive chart.
Unknowns
none recorded
Tools
Tool access not recorded
Reasoning budget
medium
Framework
not recorded
Protocol
Internal error-inducing difficult prompts; responses with any factual error; lower is better. Exact dataset, sample size and user-flagged provenance not stated in this source.
Conditions
Later GPT-6.1 Terra comparison article; GPT-6 Astra effort Medium. Chart Cost: USD 0.29 per task; exact cost-accounting and sampling settings unspecified. All 143 chart points were cross-checked against official embedded values and rendered SVG labels. This result is attributed to Astra, not to the article's Terra subject; no launch qualification is inferred.
Responses with at least one factual error5.9%Reported 5.9% · Unit %
Published Unconfirmed
GPT-6 Astra high
Settings
GPT-6 Astra; reasoning effort high as printed in the interactive chart.
Unknowns
none recorded
Tools
Tool access not recorded
Reasoning budget
high
Framework
not recorded
Protocol
Internal error-inducing difficult prompts; responses with any factual error; lower is better. Exact dataset, sample size and user-flagged provenance not stated in this source.
Conditions
Later GPT-6.1 Terra comparison article; GPT-6 Astra effort High. Chart Cost: USD 0.43 per task; exact cost-accounting and sampling settings unspecified. All 143 chart points were cross-checked against official embedded values and rendered SVG labels. This result is attributed to Astra, not to the article's Terra subject; no launch qualification is inferred.
Responses with at least one factual error4.6%Reported 4.6% · Unit %
Published Unconfirmed
GPT-6 Astra xhigh
Settings
GPT-6 Astra; reasoning effort xhigh as printed in the interactive chart.
Unknowns
none recorded
Tools
Tool access not recorded
Reasoning budget
xhigh
Framework
not recorded
Protocol
Internal error-inducing difficult prompts; responses with any factual error; lower is better. Exact dataset, sample size and user-flagged provenance not stated in this source.
Conditions
Later GPT-6.1 Terra comparison article; GPT-6 Astra effort Xhigh. Chart Cost: USD 0.55 per task; exact cost-accounting and sampling settings unspecified. All 143 chart points were cross-checked against official embedded values and rendered SVG labels. This result is attributed to Astra, not to the article's Terra subject; no launch qualification is inferred.
Responses with at least one factual error4.2%Reported 4.2% · Unit %
Published Unconfirmed
GPT-6 Astra max
Settings
GPT-6 Astra; reasoning effort max as printed in the interactive chart.
Unknowns
none recorded
Tools
Tool access not recorded
Reasoning budget
max
Framework
not recorded
Protocol
Internal error-inducing difficult prompts; responses with any factual error; lower is better. Exact dataset, sample size and user-flagged provenance not stated in this source.
Conditions
Later GPT-6.1 Terra comparison article; GPT-6 Astra effort Max. Chart Cost: USD 0.66 per task; exact cost-accounting and sampling settings unspecified. All 143 chart points were cross-checked against official embedded values and rendered SVG labels. This result is attributed to Astra, not to the article's Terra subject; no launch qualification is inferred.