DROPGoogle launches Gemini 3.8 Flash TTS and Flash-Lite TTS///DROPGemini Omni brings 1080p generation to Google Vids///BREAKClaude Opus 5.5 is here: 1M context, $4 input / $20 output///BREAKOpenAI adds GPT-6 Sol and Luna to the GPT-6 family///PAPEROpus 5.5's system card documents gains—and evaluation limits///BREAKGrok 4.7 launches at $2 input / $6 output per million tokens///DROPGrok Voice Transcribe 2.0 targets difficult real-world audio///TRENDGoogle steers new Gemini API projects to 3.8 Flash or 3.5 Flash-Lite///DROPGoogle launches Gemini 3.8 Flash TTS and Flash-Lite TTS///DROPGemini Omni brings 1080p generation to Google Vids///BREAKClaude Opus 5.5 is here: 1M context, $4 input / $20 output///BREAKOpenAI adds GPT-6 Sol and Luna to the GPT-6 family///PAPEROpus 5.5's system card documents gains—and evaluation limits///BREAKGrok 4.7 launches at $2 input / $6 output per million tokens///DROPGrok Voice Transcribe 2.0 targets difficult real-world audio///TRENDGoogle steers new Gemini API projects to 3.8 Flash or 3.5 Flash-Lite///
DARC.DEV

[ MODEL — openai / DC Model Index ]

GPT-6 Astra

GPT-6 Astra is OpenAI's flagship model for demanding end-to-end work. It is suited for advanced analysis, software engineering, deep research, scientific work, and document creation, with particular strengths in long-horizon...

Update delayed · last successful import · 437 models · Sources & methodology ↗

openai · Released 2026-09-04

GPT-6 Astra
77.2

DC Power

100% fixed panel · 4 source families
8.6

DC Eco

60.1

DC Overall

Coding

70.2

Full panel

Reasoning

92.3

Full panel

Agents

67.8

Full panel

1.05M context · $10 / $50

USD per 1M input / output tokens

GPT-6 Astra is OpenAI's flagship model for demanding end-to-end work. It is suited for advanced analysis, software engineering, deep research, scientific work, and document creation, with particular strengths in long-horizon...

Evidence & available offers →

Available offers & pricing

Catalogue listings are not a guarantee of deployability. Azure quota tier, regional capacity and account eligibility require a separate account-specific check. No account information is included here.

ProviderInput / output per 1MRegion / deploymentQuota tier
OpenRouter ↗openai/gpt-6-astra$10 / $50Not verified / On-demandAccount-specific
Azure ↗gpt-6-astra$10 / $50Not verified / Not verifiedAccount-specific
openai ↗gpt-6-astra$10 / $50Not verified / Not verifiedAccount-specific

Lowest listed Azure retail regions

For the reference workload of 3,000 input and 1,000 output tokens. Each group compares only matching deployment and processing options. Global deployments can process data outside the resource region. Data Zone regions may belong to different residency zones; check your requirements before choosing. Catalogue pricing does not confirm quota, model access or regional capacity.

  • Data Zone Standard · Standard · short context: $0.088 per task · centralus, eastus, eastus2, northcentralus, southcentralus, westus, westus3
  • Global Standard · Standard · short context: $0.08 per task · australiaeast, brazilsouth, canadacentral, canadaeast, centralus, eastus, eastus2, francecentral, germanywestcentral, italynorth, japaneast, koreacentral, northcentralus, norwayeast, polandcentral, southafricanorth, southcentralus, southindia, spaincentral, swedencentral, switzerlandnorth, switzerlandwest, uaenorth, uksouth, westeurope, westus, westus3
  • Global Standard · Flex · short context: $0.04 per task · australiaeast, brazilsouth, canadaeast, centralus, eastus, eastus2, francecentral, germanywestcentral, indonesiacentral, japaneast, koreacentral, malaysiawest, northcentralus, norwayeast, polandcentral, southafricanorth, southcentralus, southindia, spaincentral, swedencentral, switzerlandnorth, uaenorth, uksouth, westeurope, westus, westus3

Reference task estimate: $0.08 for 3,000 input + 1,000 output tokens. Cache reads: $1 / 1M tokens where listed.

Supplementary ECI index · 0% of Power

Epoch Capabilities Index: 169.07 · published 90% interval 166.16–172.28

24 ECI benchmarks; mixed source configurations. Overlapping intervals do not establish superiority or equivalence.

Epoch AI methodology & data ↗
Use GPT-6 Astra as the comparison reference →
Inspect GPT-6 Astra: weights, inputs & missing evidence

Fixed-panel coverage: 100%. All ranked models use this complete panel. ECI contributes 0%.

Coding: 70.2 · 35% of Power · 100% coverage

LiveBench 2 Coding · 25 Oct 2026 · 50% of Coding = 17.5% of Power · 93.7

LiveBench 2 Coding · 20261025: 93.70% ↗gpt-6-astra · max · LiveBench 2 20261025 · LiveBench 2 · 20261025 · LiveBench

Epoch AI original MirrorCode · 50% of Coding = 17.5% of Power · 46.7

MirrorCode: 46.70% ↗gpt-6-astra_high · Epoch Inspect · Epoch AI evaluation

Reasoning: 92.3 · 35% of Power · 100% coverage

LiveBench 2 Reasoning · 25 Oct 2026 · 40% of Reasoning = 14.0% of Power · 92.7

LiveBench 2 Reasoning · 20261025: 92.70% ↗gpt-6-astra · max · LiveBench 2 20261025 · LiveBench 2 · 20261025 · LiveBench

Epoch AI original reasoning panel · 30% of Reasoning = 10.5% of Power · 89.2

Chess Puzzles: 74.00% ↗gpt-6-astra_max · Epoch Inspect · Epoch AI evaluation · each input 33.33% of this panel

FrontierMath-Tiers-1-3-v2-Private: 93.68% ↗gpt-6-astra_max · Epoch Inspect · Epoch AI evaluation · each input 33.33% of this panel

OTIS Mock AIME 2024-2025: 100.00% ↗gpt-6-astra_max · Epoch Inspect · Epoch AI evaluation · each input 33.33% of this panel

ARC Prize · ARC-AGI-2 semi-private · 30% of Reasoning = 10.5% of Power · 95.0

ARC-AGI-2 · semi-private: 95.00% ↗GPT-6 Astra (Max) · ARC Prize leaderboard baseline · ARC Prize official leaderboard

Agents: 67.8 · 30% of Power · 100% coverage

LiveBench 2 Long Agentic · 25 Oct 2026 · 50% of Agents = 15.0% of Power · 77.5

LiveBench 2 Long Agentic · 20261025: 77.50% ↗gpt-6-astra · max · LiveBench 2 20261025 · LiveBench 2 · 20261025 · LiveBench

Terminal-Bench 4.0 · published model + agent · 50% of Agents = 15.0% of Power · 58.2

Terminal-Bench 4.0: 58.18% ↗GPT-6 Astra · Codex · max · Terminal-Bench 4.0 · Codex · Terminal-Bench public leaderboard

Power = 0.35 × 70.2 + 0.35 × 92.3 + 0.30 × 67.8 = 77.2. Full precision is used before final rounding.

Original benchmark observations

36 benchmarks · 80 observations. Each configuration stays separate. These are original percentages, before ECI chance and ceiling adjustments. Expand a score to inspect its source and conditions.

BenchmarkScoreEffort / harnessSource
GPQA diamondKnowledge
95.77%

gpt-6-astra_max

Epoch AI evaluation · epoch-run

Run: 2026-08-30 · gpqa_diamond.csv

Reported standard error: ±1.37 pp. This is not a 90% interval.

Inspect source ↗

CC BY 4.0

max / Epoch InspectEpoch AI run ↗
FrontierMath-Tiers-1-3-v2-PrivateReasoning
93.68%

gpt-6-astra_max

Epoch AI evaluation · epoch-run

Run: 2026-08-30 · frontiermath_tiers_1_3_v2.csv

Reported standard error: ±1.44 pp. This is not a 90% interval.

Inspect source ↗

CC BY 4.0

max / Epoch InspectEpoch AI run ↗
FrontierMath-Tier-4-v2-PrivateReasoning
82.93%

gpt-6-astra_none

Epoch AI evaluation · epoch-run

Run: 2026-08-30 · frontiermath_tier_4_v2.csv

Reported standard error: ±5.95 pp. This is not a 90% interval.

Inspect source ↗

CC BY 4.0

none / Epoch InspectEpoch AI run ↗
FrontierMath-Tier-4-v2-PrivateReasoning
87.80%

gpt-6-astra_low

Epoch AI evaluation · epoch-run

Run: 2026-08-30 · frontiermath_tier_4_v2.csv

Reported standard error: ±5.17 pp. This is not a 90% interval.

Inspect source ↗

CC BY 4.0

low / Epoch InspectEpoch AI run ↗
FrontierMath-Tier-4-v2-PrivateReasoning
97.56%

gpt-6-astra_medium

Epoch AI evaluation · epoch-run

Run: 2026-08-30 · frontiermath_tier_4_v2.csv

Reported standard error: ±2.44 pp. This is not a 90% interval.

Inspect source ↗

CC BY 4.0

medium / Epoch InspectEpoch AI run ↗
FrontierMath-Tier-4-v2-PrivateReasoning
97.60%

gpt-6-astra_high

Epoch AI evaluation · epoch-run

Run: 2026-08-30 · frontiermath_tier_4_v2.csv

Reported standard error: ±2.40 pp. This is not a 90% interval.

Inspect source ↗

CC BY 4.0

high / Epoch InspectEpoch AI run ↗
FrontierMath-Tier-4-v2-PrivateReasoning
97.60%

gpt-6-astra_xhigh

Epoch AI evaluation · epoch-run

Run: 2026-08-30 · frontiermath_tier_4_v2.csv

Reported standard error: ±2.40 pp. This is not a 90% interval.

Inspect source ↗

CC BY 4.0

xhigh / Epoch InspectEpoch AI run ↗
FrontierMath-Tier-4-v2-PrivateReasoning
97.60%

gpt-6-astra_max

Epoch AI evaluation · epoch-run

Run: 2026-08-30 · frontiermath_tier_4_v2.csv

Reported standard error: ±2.40 pp. This is not a 90% interval.

Inspect source ↗

CC BY 4.0

max / Epoch InspectEpoch AI run ↗
OTIS Mock AIME 2024-2025Reasoning
100.00%

gpt-6-astra_max

Epoch AI evaluation · epoch-run

Run: 2026-08-30 · otis_mock_aime_2024_2025.csv

Reported standard error: ±0.00 pp. This is not a 90% interval.

Inspect source ↗

CC BY 4.0

max / Epoch InspectEpoch AI run ↗
SimpleQA VerifiedKnowledge
75.60%

gpt-6-astra_max

Epoch AI evaluation · epoch-run

Run: 2026-08-30 · simpleqa_verified.csv

Reported standard error: ±1.36 pp. This is not a 90% interval.

Inspect source ↗

CC BY 4.0

max / Epoch InspectEpoch AI run ↗
Chess PuzzlesReasoning
76.00%

gpt-6-astra_promax

Epoch AI evaluation · epoch-run

Run: 2026-10-15 · chess_puzzles.csv

Reported standard error: ±4.29 pp. This is not a 90% interval.

Inspect source ↗

CC BY 4.0

promax / Epoch InspectEpoch AI run ↗
Chess PuzzlesReasoning
74.00%

gpt-6-astra_max

Epoch AI evaluation · epoch-run

Run: 2026-10-13 · chess_puzzles.csv

Reported standard error: ±4.41 pp. This is not a 90% interval.

Inspect source ↗

CC BY 4.0

max / Epoch InspectEpoch AI run ↗
EBR-benchOther
76.19%

gpt-6-astra_max

Epoch AI evaluation · epoch-run

Run: 2026-08-30 · ebr_bench.csv

Reported standard error: ±8.38 pp. This is not a 90% interval.

Inspect source ↗

CC BY 4.0

max / Epoch InspectEpoch AI run ↗
Mystery Game PuzzlesReasoning
84.00%

gpt-6-astra_max

Epoch AI evaluation · epoch-run

Run: 2026-08-30 · mystery_game_puzzles.csv

Reported standard error: ±3.68 pp. This is not a 90% interval.

Inspect source ↗

CC BY 4.0

max / Epoch InspectEpoch AI run ↗
MirrorCodeCoding
46.70%

gpt-6-astra_high

Epoch AI evaluation · epoch-run

Run: 2026-08-30 · mirrorcode.csv

Reported standard error: ±11.86 pp. This is not a 90% interval.

Inspect source ↗

CC BY 4.0

high / Epoch InspectEpoch AI run ↗
ARC-AGIReasoning
98.50%

gpt-6-astra_xhigh

https://arcprize.org/leaderboard · external

Run: Date not supplied · arc_agi_external.csv

Inspect source ↗

CC BY 4.0

xhigh / Not reportedExternal · via Epoch ↗
ARC-AGIReasoning
98.50%

gpt-6-astra_high

https://arcprize.org/leaderboard · external

Run: Date not supplied · arc_agi_external.csv

Inspect source ↗

CC BY 4.0

high / Not reportedExternal · via Epoch ↗
ARC-AGIReasoning
97.50%

gpt-6-astra_max

https://arcprize.org/leaderboard · external

Run: Date not supplied · arc_agi_external.csv

Inspect source ↗

CC BY 4.0

max / Not reportedExternal · via Epoch ↗
ARC-AGIReasoning
97.50%

gpt-6-astra_medium

https://arcprize.org/leaderboard · external

Run: Date not supplied · arc_agi_external.csv

Inspect source ↗

CC BY 4.0

medium / Not reportedExternal · via Epoch ↗
ARC-AGIReasoning
96.50%

gpt-6-astra_low

https://arcprize.org/leaderboard · external

Run: Date not supplied · arc_agi_external.csv

Inspect source ↗

CC BY 4.0

low / Not reportedExternal · via Epoch ↗
ARC-AGIReasoning
86.00%

gpt-6-astra_none

https://arcprize.org/leaderboard · external

Run: Date not supplied · arc_agi_external.csv

Inspect source ↗

CC BY 4.0

none / Not reportedExternal · via Epoch ↗
BalrogAgents
68.30%

gpt-6-astra_max

https://balrogai.com/ · external

Run: Date not supplied · balrog_external.csv

Inspect source ↗

CC BY 4.0

max / Not reportedExternal · via Epoch ↗
GSO-BenchCoding
79.41%

gpt-6-astra_unknown

https://gso-bench.github.io/index.html · external

Run: Date not supplied · gso_external.csv

Inspect source ↗

CC BY 4.0

unknown / Not reportedExternal · via Epoch ↗
WeirdMLCoding
93.57%

gpt-6-astra_promax

https://htihle.github.io/weirdml.html · external

Run: Date not supplied · weirdml_external.csv

Reported standard error: ±0.00 pp. This is not a 90% interval.

Inspect source ↗

CC BY 4.0

promax / Not reportedExternal · via Epoch ↗
WeirdMLCoding
93.28%

gpt-6-astra_max

https://htihle.github.io/weirdml.html · external

Run: Date not supplied · weirdml_external.csv

Reported standard error: ±0.00 pp. This is not a 90% interval.

Inspect source ↗

CC BY 4.0

max / Not reportedExternal · via Epoch ↗
WeirdMLCoding
92.87%

gpt-6-astra_high

https://htihle.github.io/weirdml.html · external

Run: Date not supplied · weirdml_external.csv

Reported standard error: ±0.00 pp. This is not a 90% interval.

Inspect source ↗

CC BY 4.0

high / Not reportedExternal · via Epoch ↗
APEX-AgentsAgents
64.70%

gpt-6-astra_unknown

External result; evaluator not specified · external

Run: Date not supplied · apex_agents_external.csv

Inspect source ↗

CC BY 4.0

unknown / Not reportedExternal · via Epoch ↗
ARC-AGI-2Reasoning
95.00%

gpt-6-astra_max

External result; evaluator not specified · external

Run: Date not supplied · arc_agi_2_external.csv

Inspect source ↗

CC BY 4.0

max / Not reportedExternal · via Epoch ↗
ARC-AGI-2Reasoning
93.33%

gpt-6-astra_xhigh

External result; evaluator not specified · external

Run: Date not supplied · arc_agi_2_external.csv

Inspect source ↗

CC BY 4.0

xhigh / Not reportedExternal · via Epoch ↗
ARC-AGI-2Reasoning
92.08%

gpt-6-astra_high

External result; evaluator not specified · external

Run: Date not supplied · arc_agi_2_external.csv

Inspect source ↗

CC BY 4.0

high / Not reportedExternal · via Epoch ↗
ARC-AGI-2Reasoning
92.08%

gpt-6-astra_medium

External result; evaluator not specified · external

Run: Date not supplied · arc_agi_2_external.csv

Inspect source ↗

CC BY 4.0

medium / Not reportedExternal · via Epoch ↗
ARC-AGI-2Reasoning
85.42%

gpt-6-astra_low

External result; evaluator not specified · external

Run: Date not supplied · arc_agi_2_external.csv

Inspect source ↗

CC BY 4.0

low / Not reportedExternal · via Epoch ↗
ARC-AGI-2Reasoning
59.58%

gpt-6-astra_none

External result; evaluator not specified · external

Run: Date not supplied · arc_agi_2_external.csv

Inspect source ↗

CC BY 4.0

none / Not reportedExternal · via Epoch ↗
HLEKnowledge
54.80%

gpt-6-astra_unknown

External result; evaluator not specified · external

Run: Date not supplied · hle_external.csv

Reported standard error: ±1.94 pp. This is not a 90% interval.

Inspect source ↗

CC BY 4.0

unknown / Not reportedExternal · via Epoch ↗
CritPtOther
31.71%

gpt-6-astra_max

External result; evaluator not specified · external

Run: Date not supplied · critpt_external.csv

Inspect source ↗

CC BY 4.0

max / Not reportedExternal · via Epoch ↗
CritPtOther
31.43%

gpt-6-astra_xhigh

External result; evaluator not specified · external

Run: Date not supplied · critpt_external.csv

Inspect source ↗

CC BY 4.0

xhigh / Not reportedExternal · via Epoch ↗
CritPtOther
29.14%

gpt-6-astra_medium

External result; evaluator not specified · external

Run: Date not supplied · critpt_external.csv

Inspect source ↗

CC BY 4.0

medium / Not reportedExternal · via Epoch ↗
CritPtOther
28.86%

gpt-6-astra_high

External result; evaluator not specified · external

Run: Date not supplied · critpt_external.csv

Inspect source ↗

CC BY 4.0

high / Not reportedExternal · via Epoch ↗
CritPtOther
26.29%

gpt-6-astra_low

External result; evaluator not specified · external

Run: Date not supplied · critpt_external.csv

Inspect source ↗

CC BY 4.0

low / Not reportedExternal · via Epoch ↗
CritPtOther
19.71%

gpt-6-astra_none

External result; evaluator not specified · external

Run: Date not supplied · critpt_external.csv

Inspect source ↗

CC BY 4.0

none / Not reportedExternal · via Epoch ↗
Remote Labor IndexAgents
20.83%

gpt-6-astra_unknown

External result; evaluator not specified · external

Run: Date not supplied · rli_external.csv

Inspect source ↗

CC BY 4.0

unknown / Not reportedExternal · via Epoch ↗
DeepSWECoding
74.12%

gpt-6-astra_xhigh

https://deepswe.datacurve.ai/ · external

Run: Date not supplied · deepswe_external.csv

Inspect source ↗

CC BY 4.0

xhigh / mini-swe-agentExternal · via Epoch ↗
DeepSWECoding
73.23%

gpt-6-astra_high

https://deepswe.datacurve.ai/ · external

Run: Date not supplied · deepswe_external.csv

Inspect source ↗

CC BY 4.0

high / mini-swe-agentExternal · via Epoch ↗
DeepSWECoding
73.23%

gpt-6-astra_max

https://deepswe.datacurve.ai/ · external

Run: Date not supplied · deepswe_external.csv

Inspect source ↗

CC BY 4.0

max / mini-swe-agentExternal · via Epoch ↗
DeepSWECoding
72.79%

gpt-6-astra_medium

https://deepswe.datacurve.ai/ · external

Run: Date not supplied · deepswe_external.csv

Inspect source ↗

CC BY 4.0

medium / mini-swe-agentExternal · via Epoch ↗
DeepSWECoding
67.04%

gpt-6-astra_low

https://deepswe.datacurve.ai/ · external

Run: Date not supplied · deepswe_external.csv

Inspect source ↗

CC BY 4.0

low / mini-swe-agentExternal · via Epoch ↗
ProofBenchReasoning
99.00%

gpt-6-astra_unknown

https://www.vals.ai/benchmarks/proof_bench · external

Run: Date not supplied · proofbench_external.csv

Inspect source ↗

CC BY 4.0

unknown / Not reportedExternal · via Epoch ↗
FrontierCodeCoding
53.26%

gpt-6-astra_max

https://cognition.com/frontiercode · external

Run: Date not supplied · frontiercode_external.csv

Inspect source ↗

CC BY 4.0

max / codexExternal · via Epoch ↗
LMCAReasoning
64.37%

gpt-6-astra_xhigh

https://conceptualreasoning.ai/lmca · external

Run: Date not supplied · lmca_external.csv

Inspect source ↗

CC BY 4.0

xhigh / Not reportedExternal · via Epoch ↗
LMCAReasoning
64.11%

gpt-6-astra_unknown

https://conceptualreasoning.ai/lmca · external

Run: Date not supplied · lmca_external.csv

Inspect source ↗

CC BY 4.0

unknown / Not reportedExternal · via Epoch ↗
LMCAReasoning
63.84%

gpt-6-astra_high

https://conceptualreasoning.ai/lmca · external

Run: Date not supplied · lmca_external.csv

Inspect source ↗

CC BY 4.0

high / Not reportedExternal · via Epoch ↗
LMCAReasoning
62.93%

gpt-6-astra_medium

https://conceptualreasoning.ai/lmca · external

Run: Date not supplied · lmca_external.csv

Inspect source ↗

CC BY 4.0

medium / Not reportedExternal · via Epoch ↗
LMCAReasoning
62.19%

gpt-6-astra_low

https://conceptualreasoning.ai/lmca · external

Run: Date not supplied · lmca_external.csv

Inspect source ↗

CC BY 4.0

low / Not reportedExternal · via Epoch ↗
DTBenchReasoning
97.33%

gpt-6-astra_xhigh

https://conceptualreasoning.ai/dtbench · external

Run: Date not supplied · dtbench_external.csv

Inspect source ↗

CC BY 4.0

xhigh / Not reportedExternal · via Epoch ↗
DTBenchReasoning
97.07%

gpt-6-astra_unknown

https://conceptualreasoning.ai/dtbench · external

Run: Date not supplied · dtbench_external.csv

Inspect source ↗

CC BY 4.0

unknown / Not reportedExternal · via Epoch ↗
DTBenchReasoning
96.53%

gpt-6-astra_high

https://conceptualreasoning.ai/dtbench · external

Run: Date not supplied · dtbench_external.csv

Inspect source ↗

CC BY 4.0

high / Not reportedExternal · via Epoch ↗
DTBenchReasoning
97.07%

gpt-6-astra_medium

https://conceptualreasoning.ai/dtbench · external

Run: Date not supplied · dtbench_external.csv

Inspect source ↗

CC BY 4.0

medium / Not reportedExternal · via Epoch ↗
DTBenchReasoning
94.93%

gpt-6-astra_low

https://conceptualreasoning.ai/dtbench · external

Run: Date not supplied · dtbench_external.csv

Inspect source ↗

CC BY 4.0

low / Not reportedExternal · via Epoch ↗
FrontierMath-ErdosReasoning
2.94%

gpt-6-astra_max

Epoch AI evaluation · epoch-run

Run: 2026-08-28 · frontiermath_erdos.csv

Reported standard error: ±2.06 pp. This is not a 90% interval.

Inspect source ↗

CC BY 4.0

max / Epoch InspectEpoch AI run ↗
Furniture AssemblyReasoning
80.00%

gpt-6-astra_max

Epoch AI evaluation · epoch-run

Run: 2026-09-10 · furniture_assembly.csv

Reported standard error: ±4.93 pp. This is not a 90% interval.

Inspect source ↗

CC BY 4.0

max / Epoch InspectEpoch AI run ↗
GDP.pdfOther
34.20%

gpt-6-astra_max

https://surgehq.ai/benchmarks/gdp-pdf · external

Run: Date not supplied · gdp_pdf_external.csv

Inspect source ↗

CC BY 4.0

max / Not reportedExternal · via Epoch ↗
FrontierSWECoding
65.51%

gpt-6-astra_max

https://www.frontierswe.com/ · external

Run: Date not supplied · frontierswe_external.csv

Inspect source ↗

CC BY 4.0

max / proximusExternal · via Epoch ↗
WeirdML v3Coding
54.05%

gpt-6-astra_xhigh

https://htihle.github.io/weirdml.html · external

Run: Date not supplied · weirdml_v3_external.csv

Inspect source ↗

CC BY 4.0

xhigh / codex_cliExternal · via Epoch ↗
SpireClimb (Slay the Spire 1, Ascension 20 Heart)Other
33.33%

gpt-6-astra_max

Epoch AI evaluation · epoch-run

Run: 2026-11-04 · spireclimb_sts1_a20_heart.csv

Reported standard error: ±6.14 pp. This is not a 90% interval.

Inspect source ↗

CC BY 4.0

max / Epoch InspectEpoch AI run ↗
SpireClimb (Slay the Spire 2, Ascension 10)Other
34.67%

gpt-6-astra_max

Epoch AI evaluation · epoch-run

Run: 2026-09-22 · spireclimb_sts2_a10.csv

Reported standard error: ±5.53 pp. This is not a 90% interval.

Inspect source ↗

CC BY 4.0

max / Epoch InspectEpoch AI run ↗
SpireClimbOther
34.00%

gpt-6-astra_max

Epoch AI evaluation · epoch-run

Run: 2026-11-04 · spireclimb.csv

Reported standard error: ±4.13 pp. This is not a 90% interval.

Inspect source ↗

CC BY 4.0

max / Epoch InspectEpoch AI run ↗
LiveBench 2 Coding · 20261025Coding
93.70%

gpt-6-astra · max · LiveBench 2 20261025

LiveBench · independent-run

Run: Date not supplied · 20261025/table.csv

Benchmark edition 25 October 2026; individual run date not supplied. One run per model; mean task score. Failed/unmeasurable tasks score zero in the source. Source effort metadata is preserved.

Inspect source ↗

Attributed public leaderboard score facts · LiveBench

max / LiveBench 2 · 20261025LiveBench ↗
LiveBench 2 Reasoning · 20261025Reasoning
92.70%

gpt-6-astra · max · LiveBench 2 20261025

LiveBench · independent-run

Run: Date not supplied · 20261025/table.csv

Benchmark edition 25 October 2026; individual run date not supplied. One run per model; mean task score. Failed/unmeasurable tasks score zero in the source. Source effort metadata is preserved.

Inspect source ↗

Attributed public leaderboard score facts · LiveBench

max / LiveBench 2 · 20261025LiveBench ↗
LiveBench 2 Long Agentic · 20261025Agents
77.50%

gpt-6-astra · max · LiveBench 2 20261025

LiveBench · independent-run

Run: Date not supplied · 20261025/table.csv

Benchmark edition 25 October 2026; individual run date not supplied. One run per model; mean task score. Failed/unmeasurable tasks score zero in the source. Source effort metadata is preserved.

Inspect source ↗

Attributed public leaderboard score facts · LiveBench

max / LiveBench 2 · 20261025LiveBench ↗
Terminal-Bench 4.0Agents
58.18%

GPT-6 Astra · Codex · max

Terminal-Bench public leaderboard · benchmark-publisher

Run: 2026-09-03 · 4-0-0/5c537be4-7fc3-449b-8bfc-ceb9061c2535

Published model + agent result; agents differ across models. Not a controlled model-only evaluation. Reported trials: 330. Source 95% accuracy interval half-width: 2.79 pp; this is not a DC Power interval.

Inspect source ↗

Attributed public leaderboard score facts · Terminal-Bench

max / Terminal-Bench 4.0 · CodexTerminal-Bench ↗
Terminal-Bench 4.0Agents
57.88%

GPT-6 Astra · Codex · xhigh

Terminal-Bench public leaderboard · benchmark-publisher

Run: 2026-09-03 · 4-0-0/16db8ad5-84aa-4588-b660-1ce68c0d45e2

Published model + agent result; agents differ across models. Not a controlled model-only evaluation. Reported trials: 330. Source 95% accuracy interval half-width: 2.72 pp; this is not a DC Power interval.

Inspect source ↗

Attributed public leaderboard score facts · Terminal-Bench

xhigh / Terminal-Bench 4.0 · CodexTerminal-Bench ↗
Terminal-Bench 4.0Agents
57.88%

GPT-6 Astra · Codex · high

Terminal-Bench public leaderboard · benchmark-publisher

Run: 2026-09-03 · 4-0-0/3475050c-bf5e-4261-a3f6-0af5350af13f

Published model + agent result; agents differ across models. Not a controlled model-only evaluation. Reported trials: 330. Source 95% accuracy interval half-width: 2.97 pp; this is not a DC Power interval.

Inspect source ↗

Attributed public leaderboard score facts · Terminal-Bench

high / Terminal-Bench 4.0 · CodexTerminal-Bench ↗
Terminal-Bench 4.0Agents
54.24%

GPT-6 Astra · Codex · medium

Terminal-Bench public leaderboard · benchmark-publisher

Run: 2026-09-03 · 4-0-0/f3c3d5a6-6424-4acb-bfcc-615c3f79f6dd

Published model + agent result; agents differ across models. Not a controlled model-only evaluation. Reported trials: 330. Source 95% accuracy interval half-width: 2.66 pp; this is not a DC Power interval.

Inspect source ↗

Attributed public leaderboard score facts · Terminal-Bench

medium / Terminal-Bench 4.0 · CodexTerminal-Bench ↗
Terminal-Bench 4.0Agents
50.61%

GPT-6 Astra · Codex · low

Terminal-Bench public leaderboard · benchmark-publisher

Run: 2026-09-03 · 4-0-0/b3ad58f3-b311-4d4d-875b-3158cf0309d6

Published model + agent result; agents differ across models. Not a controlled model-only evaluation. Reported trials: 330. Source 95% accuracy interval half-width: 2.75 pp; this is not a DC Power interval.

Inspect source ↗

Attributed public leaderboard score facts · Terminal-Bench

low / Terminal-Bench 4.0 · CodexTerminal-Bench ↗
ARC-AGI-2 · semi-privateReasoning
95.00%

GPT-6 Astra (Max)

ARC Prize official leaderboard · benchmark-publisher

Run: Date not supplied · evaluations.json · v2_Semi_Private

Reported benchmark cost: $1.119468 per task. Different from the token-workload estimate.

Semi-private split only. Provider-adapter and custom-scaffold families are kept separate. Identical effort names do not imply identical compute budgets.

Inspect source ↗

Public leaderboard facts · ARC Prize

max / ARC Prize leaderboard baselineARC Prize ↗
ARC-AGI-2 · semi-privateReasoning
93.33%

GPT-6 Astra (XHigh)

ARC Prize official leaderboard · benchmark-publisher

Run: Date not supplied · evaluations.json · v2_Semi_Private

Reported benchmark cost: $0.828686 per task. Different from the token-workload estimate.

Semi-private split only. Provider-adapter and custom-scaffold families are kept separate. Identical effort names do not imply identical compute budgets.

Inspect source ↗

Public leaderboard facts · ARC Prize

xhigh / ARC Prize leaderboard baselineARC Prize ↗
ARC-AGI-2 · semi-privateReasoning
92.08%

GPT-6 Astra (High)

ARC Prize official leaderboard · benchmark-publisher

Run: Date not supplied · evaluations.json · v2_Semi_Private

Reported benchmark cost: $0.668079 per task. Different from the token-workload estimate.

Semi-private split only. Provider-adapter and custom-scaffold families are kept separate. Identical effort names do not imply identical compute budgets.

Inspect source ↗

Public leaderboard facts · ARC Prize

high / ARC Prize leaderboard baselineARC Prize ↗
ARC-AGI-2 · semi-privateReasoning
92.08%

GPT-6 Astra (Medium)

ARC Prize official leaderboard · benchmark-publisher

Run: Date not supplied · evaluations.json · v2_Semi_Private

Reported benchmark cost: $0.480093 per task. Different from the token-workload estimate.

Semi-private split only. Provider-adapter and custom-scaffold families are kept separate. Identical effort names do not imply identical compute budgets.

Inspect source ↗

Public leaderboard facts · ARC Prize

medium / ARC Prize leaderboard baselineARC Prize ↗
ARC-AGI-2 · semi-privateReasoning
85.42%

GPT-6 Astra (Low)

ARC Prize official leaderboard · benchmark-publisher

Run: Date not supplied · evaluations.json · v2_Semi_Private

Reported benchmark cost: $0.416242 per task. Different from the token-workload estimate.

Semi-private split only. Provider-adapter and custom-scaffold families are kept separate. Identical effort names do not imply identical compute budgets.

Inspect source ↗

Public leaderboard facts · ARC Prize

low / ARC Prize leaderboard baselineARC Prize ↗
ARC-AGI-2 · semi-privateReasoning
59.58%

GPT-6 Astra (None)

ARC Prize official leaderboard · benchmark-publisher

Run: Date not supplied · evaluations.json · v2_Semi_Private

Reported benchmark cost: $0.369674 per task. Different from the token-workload estimate.

Semi-private split only. Provider-adapter and custom-scaffold families are kept separate. Identical effort names do not imply identical compute budgets.

Inspect source ↗

Public leaderboard facts · ARC Prize

none / ARC Prize leaderboard baselineARC Prize ↗

DC Score v3 / independent source families

One fixed panel. Every weight visible.

DC Power is our weighted aggregate of raw benchmark scores from LiveBench, Epoch AI, ARC Prize and Terminal-Bench. It is not an ECI rescaling. Power = 0.35 × Coding + 0.35 × Reasoning + 0.30 × Agents. These are explicit editorial preferences, not statistically learned weights or a probability of success.

DomainPower weightSource panels within the domain
Coding35%

50% LiveBench 2 Coding · 25 Oct 2026

50% Epoch AI original MirrorCode

Reasoning35%

40% LiveBench 2 Reasoning · 25 Oct 2026

30% Epoch AI original reasoning panel

30% ARC Prize · ARC-AGI-2 semi-private

Agents30%

50% LiveBench 2 Long Agentic · 25 Oct 2026

50% Terminal-Bench 4.0 · published model + agent

Source balance. At full coverage, LiveBench contributes 46.5%, original Epoch AI runs 28%, ARC Prize 10.5% and Terminal-Bench 15%. One source does not gain weight by publishing more rows. ECI, vendor reports and external scores republished through Epoch have zero Power weight. Direct ARC and Terminal results enter once.

Epoch reasoning panel. Equal weights for original Epoch-run Chess Puzzles, FrontierMath tiers 1–3 v2 private and OTIS Mock AIME 2024–2025. All three are required. GPQA and other supplementary tests stay in the matrix; vendor-only GPQA reports do not become independent Epoch runs.

Missing evidence stays visible. Power, Eco and Overall require every fixed source panel. Domain scores can show a partial summary: available panel weights are renormalized, with coverage and missing inputs shown. A partial score is not a win against a complete score. The same complete panel is required for every ranked model.

Fixed editions and effort policy. LiveBench 2 edition 25 October 2026 and Terminal-Bench 4.0. Select known effort in this order: max, xhigh, high, medium, low, minimal, none, declared highest-supported. Never select the largest numerical result. A dated later run can replace an earlier run under the same setup; unresolved conflicts or different harnesses are missing.

Publisher independence is limited. Four separate source organizations do not imply blind or independently reproduced runs, independent funding, equal compute budgets or uncorrelated tests. Terminal-Bench measures a model with its published agent; Claude Code, Codex and other harnesses differ. Inspect the selected configurations. Public benchmark data cannot establish outcomes in your application.

No invented confidence interval. We do not convert ECI uncertainty into uncertainty for this aggregate. No statistically valid DC Power interval is available. Raw means are averaged on their original 0–100 scales; test difficulty and contamination can affect results. A small aggregate difference is descriptive, not proof of superiority.

Token cost C = (3,000 × input rate + 1,000 × output rate) / 1,000,000, uncached. DC Eco = Power / (1 + 100 × C), eligible only for complete Power ≥ 50 and known prices. At $0.01, Eco is half Power. DC Overall = 0.75 × Power + 0.25 × Eco. Use the comparison calculator for your workload and quality weight.

Cost is conditional. Prices are listed USD per million tokens. Reasoning tokens, tools, retries, cache writes, discounts and long-context surcharges are excluded. These are token-spend estimates, not measured cost per successful task. Quality benchmark effort does not establish a matching token workload.

Inspect Claude Fable 5.1: weights, inputs & missing evidence

Fixed-panel coverage: 100%. All ranked models use this complete panel. ECI contributes 0%.

Coding: 85.5 · 35% of Power · 100% coverage

LiveBench 2 Coding · 25 Oct 2026 · 50% of Coding = 17.5% of Power · 97.7

LiveBench 2 Coding · 20261025: 97.70% ↗claude-fable-5.1 · max · LiveBench 2 20261025 · LiveBench 2 · 20261025 · LiveBench

Epoch AI original MirrorCode · 50% of Coding = 17.5% of Power · 73.3

MirrorCode: 73.30% ↗claude-fable-5-1_high · Epoch Inspect · Epoch AI evaluation

Reasoning: 87.5 · 35% of Power · 100% coverage

LiveBench 2 Reasoning · 25 Oct 2026 · 40% of Reasoning = 14.0% of Power · 91.7

LiveBench 2 Reasoning · 20261025: 91.70% ↗claude-fable-5.1 · max · LiveBench 2 20261025 · LiveBench 2 · 20261025 · LiveBench

Epoch AI original reasoning panel · 30% of Reasoning = 10.5% of Power · 79.4

Chess Puzzles: 48.00% ↗claude-fable-5-1_max · Epoch Inspect · Epoch AI evaluation · each input 33.33% of this panel

FrontierMath-Tiers-1-3-v2-Private: 90.18% ↗claude-fable-5-1_max · Epoch Inspect · Epoch AI evaluation · each input 33.33% of this panel

OTIS Mock AIME 2024-2025: 100.00% ↗claude-fable-5-1_max · Epoch Inspect · Epoch AI evaluation · each input 33.33% of this panel

ARC Prize · ARC-AGI-2 semi-private · 30% of Reasoning = 10.5% of Power · 90.0

ARC-AGI-2 · semi-private: 90.00% ↗Claude Fable 5.1 (Max) · ARC Prize leaderboard baseline · ARC Prize official leaderboard

Agents: 67.9 · 30% of Power · 100% coverage

LiveBench 2 Long Agentic · 25 Oct 2026 · 50% of Agents = 15.0% of Power · 77.9

LiveBench 2 Long Agentic · 20261025: 77.90% ↗claude-fable-5.1 · max · LiveBench 2 20261025 · LiveBench 2 · 20261025 · LiveBench

Terminal-Bench 4.0 · published model + agent · 50% of Agents = 15.0% of Power · 57.9

Terminal-Bench 4.0: 57.88% ↗Claude Fable 5.1 · Claude Code · max · Terminal-Bench 4.0 · Claude Code · Terminal-Bench public leaderboard

Power = 0.35 × 85.5 + 0.35 × 87.5 + 0.30 × 67.9 = 80.9. Full precision is used before final rounding.

Reference token cost: $0.08 · Eco: 9.0 · Overall: 62.9

v3 replaces the previous ECI transform; scores across methodology versions are not directly comparable. Data refreshes every six hours, not on each page view. Benchmark editions are pinned for comparability; changing the test panel requires a methodology revision. Imports older than 24 hours are marked delayed. Catalogue releases continue to update independently. Azure listings do not confirm account quota or regional capacity.

OpenRouter catalogue ↗ · Public catalogue API; attributed metadata and list prices

models.dev ↗ · MIT

Epoch AI, Capabilities & benchmarking ↗ · CC BY 4.0; only original Epoch-run panel observations enter Power; ECI has zero weight

ARC Prize official leaderboard ↗ · Attributed public leaderboard facts; semi-private split; one direct Power panel, never counted through Epoch again

LiveBench 2 · 25 October 2026 ↗ · Attributed public score facts; original Coding, Reasoning and Long Agentic suites

Terminal-Bench 4.0 ↗ · Attributed public score facts; published model plus agent, not a model-only ablation

Microsoft Azure Retail Prices ↗ · Public retail meters; deployment eligibility is not confirmed

Epoch data: CC BY 4.0. Other publishers: attributed public leaderboard score facts. DARC.DEV defines the aggregate and makes no claim of source endorsement. No private account details are published.

← Back to DC Model Index