| GPQA diamondKnowledge | 95.77%gpt-6-astra_max Epoch AI evaluation · epoch-run Run: 2026-08-30 · gpqa_diamond.csv Reported standard error: ±1.37 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tiers-1-3-v2-PrivateReasoning | 93.68%gpt-6-astra_max Epoch AI evaluation · epoch-run Run: 2026-08-30 · frontiermath_tiers_1_3_v2.csv Reported standard error: ±1.44 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tier-4-v2-PrivateReasoning | 82.93%gpt-6-astra_none Epoch AI evaluation · epoch-run Run: 2026-08-30 · frontiermath_tier_4_v2.csv Reported standard error: ±5.95 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | none / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tier-4-v2-PrivateReasoning | 87.80%gpt-6-astra_low Epoch AI evaluation · epoch-run Run: 2026-08-30 · frontiermath_tier_4_v2.csv Reported standard error: ±5.17 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | low / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tier-4-v2-PrivateReasoning | 97.56%gpt-6-astra_medium Epoch AI evaluation · epoch-run Run: 2026-08-30 · frontiermath_tier_4_v2.csv Reported standard error: ±2.44 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tier-4-v2-PrivateReasoning | 97.60%gpt-6-astra_high Epoch AI evaluation · epoch-run Run: 2026-08-30 · frontiermath_tier_4_v2.csv Reported standard error: ±2.40 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tier-4-v2-PrivateReasoning | 97.60%gpt-6-astra_xhigh Epoch AI evaluation · epoch-run Run: 2026-08-30 · frontiermath_tier_4_v2.csv Reported standard error: ±2.40 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | xhigh / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tier-4-v2-PrivateReasoning | 97.60%gpt-6-astra_max Epoch AI evaluation · epoch-run Run: 2026-08-30 · frontiermath_tier_4_v2.csv Reported standard error: ±2.40 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 100.00%gpt-6-astra_max Epoch AI evaluation · epoch-run Run: 2026-08-30 · otis_mock_aime_2024_2025.csv Reported standard error: ±0.00 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| SimpleQA VerifiedKnowledge | 75.60%gpt-6-astra_max Epoch AI evaluation · epoch-run Run: 2026-08-30 · simpleqa_verified.csv Reported standard error: ±1.36 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| Chess PuzzlesReasoning | 76.00%gpt-6-astra_promax Epoch AI evaluation · epoch-run Run: 2026-10-15 · chess_puzzles.csv Reported standard error: ±4.29 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | promax / Epoch Inspect | Epoch AI run ↗ |
|---|
| Chess PuzzlesReasoning | 74.00%gpt-6-astra_max Epoch AI evaluation · epoch-run Run: 2026-10-13 · chess_puzzles.csv Reported standard error: ±4.41 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| EBR-benchOther | 76.19%gpt-6-astra_max Epoch AI evaluation · epoch-run Run: 2026-08-30 · ebr_bench.csv Reported standard error: ±8.38 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| Mystery Game PuzzlesReasoning | 84.00%gpt-6-astra_max Epoch AI evaluation · epoch-run Run: 2026-08-30 · mystery_game_puzzles.csv Reported standard error: ±3.68 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| MirrorCodeCoding | 46.70%gpt-6-astra_high Epoch AI evaluation · epoch-run Run: 2026-08-30 · mirrorcode.csv Reported standard error: ±11.86 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| ARC-AGIReasoning | 98.50%gpt-6-astra_xhigh https://arcprize.org/leaderboard · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | xhigh / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 98.50%gpt-6-astra_high https://arcprize.org/leaderboard · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 97.50%gpt-6-astra_max https://arcprize.org/leaderboard · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 97.50%gpt-6-astra_medium https://arcprize.org/leaderboard · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 96.50%gpt-6-astra_low https://arcprize.org/leaderboard · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 86.00%gpt-6-astra_none https://arcprize.org/leaderboard · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | none / Not reported | External · via Epoch ↗ |
|---|
| BalrogAgents | 68.30%gpt-6-astra_max https://balrogai.com/ · external Run: Date not supplied · balrog_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| GSO-BenchCoding | 79.41%gpt-6-astra_unknown https://gso-bench.github.io/index.html · external Run: Date not supplied · gso_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| WeirdMLCoding | 93.57%gpt-6-astra_promax https://htihle.github.io/weirdml.html · external Run: Date not supplied · weirdml_external.csv Reported standard error: ±0.00 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | promax / Not reported | External · via Epoch ↗ |
|---|
| WeirdMLCoding | 93.28%gpt-6-astra_max https://htihle.github.io/weirdml.html · external Run: Date not supplied · weirdml_external.csv Reported standard error: ±0.00 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| WeirdMLCoding | 92.87%gpt-6-astra_high https://htihle.github.io/weirdml.html · external Run: Date not supplied · weirdml_external.csv Reported standard error: ±0.00 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| APEX-AgentsAgents | 64.70%gpt-6-astra_unknown External result; evaluator not specified · external Run: Date not supplied · apex_agents_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 95.00%gpt-6-astra_max External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 93.33%gpt-6-astra_xhigh External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | xhigh / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 92.08%gpt-6-astra_high External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 92.08%gpt-6-astra_medium External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 85.42%gpt-6-astra_low External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 59.58%gpt-6-astra_none External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | none / Not reported | External · via Epoch ↗ |
|---|
| HLEKnowledge | 54.80%gpt-6-astra_unknown External result; evaluator not specified · external Run: Date not supplied · hle_external.csv Reported standard error: ±1.94 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| CritPtOther | 31.71%gpt-6-astra_max External result; evaluator not specified · external Run: Date not supplied · critpt_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| CritPtOther | 31.43%gpt-6-astra_xhigh External result; evaluator not specified · external Run: Date not supplied · critpt_external.csv Inspect source ↗CC BY 4.0 | xhigh / Not reported | External · via Epoch ↗ |
|---|
| CritPtOther | 29.14%gpt-6-astra_medium External result; evaluator not specified · external Run: Date not supplied · critpt_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| CritPtOther | 28.86%gpt-6-astra_high External result; evaluator not specified · external Run: Date not supplied · critpt_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| CritPtOther | 26.29%gpt-6-astra_low External result; evaluator not specified · external Run: Date not supplied · critpt_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| CritPtOther | 19.71%gpt-6-astra_none External result; evaluator not specified · external Run: Date not supplied · critpt_external.csv Inspect source ↗CC BY 4.0 | none / Not reported | External · via Epoch ↗ |
|---|
| Remote Labor IndexAgents | 20.83%gpt-6-astra_unknown External result; evaluator not specified · external Run: Date not supplied · rli_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| DeepSWECoding | 74.12%gpt-6-astra_xhigh https://deepswe.datacurve.ai/ · external Run: Date not supplied · deepswe_external.csv Inspect source ↗CC BY 4.0 | xhigh / mini-swe-agent | External · via Epoch ↗ |
|---|
| DeepSWECoding | 73.23%gpt-6-astra_high https://deepswe.datacurve.ai/ · external Run: Date not supplied · deepswe_external.csv Inspect source ↗CC BY 4.0 | high / mini-swe-agent | External · via Epoch ↗ |
|---|
| DeepSWECoding | 73.23%gpt-6-astra_max https://deepswe.datacurve.ai/ · external Run: Date not supplied · deepswe_external.csv Inspect source ↗CC BY 4.0 | max / mini-swe-agent | External · via Epoch ↗ |
|---|
| DeepSWECoding | 72.79%gpt-6-astra_medium https://deepswe.datacurve.ai/ · external Run: Date not supplied · deepswe_external.csv Inspect source ↗CC BY 4.0 | medium / mini-swe-agent | External · via Epoch ↗ |
|---|
| DeepSWECoding | 67.04%gpt-6-astra_low https://deepswe.datacurve.ai/ · external Run: Date not supplied · deepswe_external.csv Inspect source ↗CC BY 4.0 | low / mini-swe-agent | External · via Epoch ↗ |
|---|
| ProofBenchReasoning | 99.00%gpt-6-astra_unknown https://www.vals.ai/benchmarks/proof_bench · external Run: Date not supplied · proofbench_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| FrontierCodeCoding | 53.26%gpt-6-astra_max https://cognition.com/frontiercode · external Run: Date not supplied · frontiercode_external.csv Inspect source ↗CC BY 4.0 | max / codex | External · via Epoch ↗ |
|---|
| LMCAReasoning | 64.37%gpt-6-astra_xhigh https://conceptualreasoning.ai/lmca · external Run: Date not supplied · lmca_external.csv Inspect source ↗CC BY 4.0 | xhigh / Not reported | External · via Epoch ↗ |
|---|
| LMCAReasoning | 64.11%gpt-6-astra_unknown https://conceptualreasoning.ai/lmca · external Run: Date not supplied · lmca_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| LMCAReasoning | 63.84%gpt-6-astra_high https://conceptualreasoning.ai/lmca · external Run: Date not supplied · lmca_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| LMCAReasoning | 62.93%gpt-6-astra_medium https://conceptualreasoning.ai/lmca · external Run: Date not supplied · lmca_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| LMCAReasoning | 62.19%gpt-6-astra_low https://conceptualreasoning.ai/lmca · external Run: Date not supplied · lmca_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| DTBenchReasoning | 97.33%gpt-6-astra_xhigh https://conceptualreasoning.ai/dtbench · external Run: Date not supplied · dtbench_external.csv Inspect source ↗CC BY 4.0 | xhigh / Not reported | External · via Epoch ↗ |
|---|
| DTBenchReasoning | 97.07%gpt-6-astra_unknown https://conceptualreasoning.ai/dtbench · external Run: Date not supplied · dtbench_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| DTBenchReasoning | 96.53%gpt-6-astra_high https://conceptualreasoning.ai/dtbench · external Run: Date not supplied · dtbench_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| DTBenchReasoning | 97.07%gpt-6-astra_medium https://conceptualreasoning.ai/dtbench · external Run: Date not supplied · dtbench_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| DTBenchReasoning | 94.93%gpt-6-astra_low https://conceptualreasoning.ai/dtbench · external Run: Date not supplied · dtbench_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| FrontierMath-ErdosReasoning | 2.94%gpt-6-astra_max Epoch AI evaluation · epoch-run Run: 2026-08-28 · frontiermath_erdos.csv Reported standard error: ±2.06 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| Furniture AssemblyReasoning | 80.00%gpt-6-astra_max Epoch AI evaluation · epoch-run Run: 2026-09-10 · furniture_assembly.csv Reported standard error: ±4.93 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| GDP.pdfOther | 34.20%gpt-6-astra_max https://surgehq.ai/benchmarks/gdp-pdf · external Run: Date not supplied · gdp_pdf_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| FrontierSWECoding | 65.51%gpt-6-astra_max https://www.frontierswe.com/ · external Run: Date not supplied · frontierswe_external.csv Inspect source ↗CC BY 4.0 | max / proximus | External · via Epoch ↗ |
|---|
| WeirdML v3Coding | 54.05%gpt-6-astra_xhigh https://htihle.github.io/weirdml.html · external Run: Date not supplied · weirdml_v3_external.csv Inspect source ↗CC BY 4.0 | xhigh / codex_cli | External · via Epoch ↗ |
|---|
| SpireClimb (Slay the Spire 1, Ascension 20 Heart)Other | 33.33%gpt-6-astra_max Epoch AI evaluation · epoch-run Run: 2026-11-04 · spireclimb_sts1_a20_heart.csv Reported standard error: ±6.14 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| SpireClimb (Slay the Spire 2, Ascension 10)Other | 34.67%gpt-6-astra_max Epoch AI evaluation · epoch-run Run: 2026-09-22 · spireclimb_sts2_a10.csv Reported standard error: ±5.53 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| SpireClimbOther | 34.00%gpt-6-astra_max Epoch AI evaluation · epoch-run Run: 2026-11-04 · spireclimb.csv Reported standard error: ±4.13 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| LiveBench 2 Coding · 20261025Coding | 93.70%gpt-6-astra · max · LiveBench 2 20261025 LiveBench · independent-run Run: Date not supplied · 20261025/table.csv Benchmark edition 25 October 2026; individual run date not supplied. One run per model; mean task score. Failed/unmeasurable tasks score zero in the source. Source effort metadata is preserved. Inspect source ↗Attributed public leaderboard score facts · LiveBench | max / LiveBench 2 · 20261025 | LiveBench ↗ |
|---|
| LiveBench 2 Reasoning · 20261025Reasoning | 92.70%gpt-6-astra · max · LiveBench 2 20261025 LiveBench · independent-run Run: Date not supplied · 20261025/table.csv Benchmark edition 25 October 2026; individual run date not supplied. One run per model; mean task score. Failed/unmeasurable tasks score zero in the source. Source effort metadata is preserved. Inspect source ↗Attributed public leaderboard score facts · LiveBench | max / LiveBench 2 · 20261025 | LiveBench ↗ |
|---|
| LiveBench 2 Long Agentic · 20261025Agents | 77.50%gpt-6-astra · max · LiveBench 2 20261025 LiveBench · independent-run Run: Date not supplied · 20261025/table.csv Benchmark edition 25 October 2026; individual run date not supplied. One run per model; mean task score. Failed/unmeasurable tasks score zero in the source. Source effort metadata is preserved. Inspect source ↗Attributed public leaderboard score facts · LiveBench | max / LiveBench 2 · 20261025 | LiveBench ↗ |
|---|
| Terminal-Bench 4.0Agents | 58.18%GPT-6 Astra · Codex · max Terminal-Bench public leaderboard · benchmark-publisher Run: 2026-09-03 · 4-0-0/5c537be4-7fc3-449b-8bfc-ceb9061c2535 Published model + agent result; agents differ across models. Not a controlled model-only evaluation. Reported trials: 330. Source 95% accuracy interval half-width: 2.79 pp; this is not a DC Power interval. Inspect source ↗Attributed public leaderboard score facts · Terminal-Bench | max / Terminal-Bench 4.0 · Codex | Terminal-Bench ↗ |
|---|
| Terminal-Bench 4.0Agents | 57.88%GPT-6 Astra · Codex · xhigh Terminal-Bench public leaderboard · benchmark-publisher Run: 2026-09-03 · 4-0-0/16db8ad5-84aa-4588-b660-1ce68c0d45e2 Published model + agent result; agents differ across models. Not a controlled model-only evaluation. Reported trials: 330. Source 95% accuracy interval half-width: 2.72 pp; this is not a DC Power interval. Inspect source ↗Attributed public leaderboard score facts · Terminal-Bench | xhigh / Terminal-Bench 4.0 · Codex | Terminal-Bench ↗ |
|---|
| Terminal-Bench 4.0Agents | 57.88%GPT-6 Astra · Codex · high Terminal-Bench public leaderboard · benchmark-publisher Run: 2026-09-03 · 4-0-0/3475050c-bf5e-4261-a3f6-0af5350af13f Published model + agent result; agents differ across models. Not a controlled model-only evaluation. Reported trials: 330. Source 95% accuracy interval half-width: 2.97 pp; this is not a DC Power interval. Inspect source ↗Attributed public leaderboard score facts · Terminal-Bench | high / Terminal-Bench 4.0 · Codex | Terminal-Bench ↗ |
|---|
| Terminal-Bench 4.0Agents | 54.24%GPT-6 Astra · Codex · medium Terminal-Bench public leaderboard · benchmark-publisher Run: 2026-09-03 · 4-0-0/f3c3d5a6-6424-4acb-bfcc-615c3f79f6dd Published model + agent result; agents differ across models. Not a controlled model-only evaluation. Reported trials: 330. Source 95% accuracy interval half-width: 2.66 pp; this is not a DC Power interval. Inspect source ↗Attributed public leaderboard score facts · Terminal-Bench | medium / Terminal-Bench 4.0 · Codex | Terminal-Bench ↗ |
|---|
| Terminal-Bench 4.0Agents | 50.61%GPT-6 Astra · Codex · low Terminal-Bench public leaderboard · benchmark-publisher Run: 2026-09-03 · 4-0-0/b3ad58f3-b311-4d4d-875b-3158cf0309d6 Published model + agent result; agents differ across models. Not a controlled model-only evaluation. Reported trials: 330. Source 95% accuracy interval half-width: 2.75 pp; this is not a DC Power interval. Inspect source ↗Attributed public leaderboard score facts · Terminal-Bench | low / Terminal-Bench 4.0 · Codex | Terminal-Bench ↗ |
|---|
| ARC-AGI-2 · semi-privateReasoning | 95.00%GPT-6 Astra (Max) ARC Prize official leaderboard · benchmark-publisher Run: Date not supplied · evaluations.json · v2_Semi_Private Reported benchmark cost: $1.119468 per task. Different from the token-workload estimate. Semi-private split only. Provider-adapter and custom-scaffold families are kept separate. Identical effort names do not imply identical compute budgets. Inspect source ↗Public leaderboard facts · ARC Prize | max / ARC Prize leaderboard baseline | ARC Prize ↗ |
|---|
| ARC-AGI-2 · semi-privateReasoning | 93.33%GPT-6 Astra (XHigh) ARC Prize official leaderboard · benchmark-publisher Run: Date not supplied · evaluations.json · v2_Semi_Private Reported benchmark cost: $0.828686 per task. Different from the token-workload estimate. Semi-private split only. Provider-adapter and custom-scaffold families are kept separate. Identical effort names do not imply identical compute budgets. Inspect source ↗Public leaderboard facts · ARC Prize | xhigh / ARC Prize leaderboard baseline | ARC Prize ↗ |
|---|
| ARC-AGI-2 · semi-privateReasoning | 92.08%GPT-6 Astra (High) ARC Prize official leaderboard · benchmark-publisher Run: Date not supplied · evaluations.json · v2_Semi_Private Reported benchmark cost: $0.668079 per task. Different from the token-workload estimate. Semi-private split only. Provider-adapter and custom-scaffold families are kept separate. Identical effort names do not imply identical compute budgets. Inspect source ↗Public leaderboard facts · ARC Prize | high / ARC Prize leaderboard baseline | ARC Prize ↗ |
|---|
| ARC-AGI-2 · semi-privateReasoning | 92.08%GPT-6 Astra (Medium) ARC Prize official leaderboard · benchmark-publisher Run: Date not supplied · evaluations.json · v2_Semi_Private Reported benchmark cost: $0.480093 per task. Different from the token-workload estimate. Semi-private split only. Provider-adapter and custom-scaffold families are kept separate. Identical effort names do not imply identical compute budgets. Inspect source ↗Public leaderboard facts · ARC Prize | medium / ARC Prize leaderboard baseline | ARC Prize ↗ |
|---|
| ARC-AGI-2 · semi-privateReasoning | 85.42%GPT-6 Astra (Low) ARC Prize official leaderboard · benchmark-publisher Run: Date not supplied · evaluations.json · v2_Semi_Private Reported benchmark cost: $0.416242 per task. Different from the token-workload estimate. Semi-private split only. Provider-adapter and custom-scaffold families are kept separate. Identical effort names do not imply identical compute budgets. Inspect source ↗Public leaderboard facts · ARC Prize | low / ARC Prize leaderboard baseline | ARC Prize ↗ |
|---|
| ARC-AGI-2 · semi-privateReasoning | 59.58%GPT-6 Astra (None) ARC Prize official leaderboard · benchmark-publisher Run: Date not supplied · evaluations.json · v2_Semi_Private Reported benchmark cost: $0.369674 per task. Different from the token-workload estimate. Semi-private split only. Provider-adapter and custom-scaffold families are kept separate. Identical effort names do not imply identical compute budgets. Inspect source ↗Public leaderboard facts · ARC Prize | none / ARC Prize leaderboard baseline | ARC Prize ↗ |
|---|