| GPQA diamondKnowledge | 71.72%gpt-5-2025-08-07_minimal Epoch AI evaluation · epoch-run Run: 2026-07-20 · gpqa_diamond.csv Reported standard error: ±3.21 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | minimal / Epoch Inspect | Epoch AI run ↗ |
|---|
| GPQA diamondKnowledge | 86.17%gpt-5-2025-08-07_high Epoch AI evaluation · epoch-run Run: 2025-10-29 · gpqa_diamond.csv Reported standard error: ±2.08 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| GPQA diamondKnowledge | 85.35%gpt-5-2025-08-07_medium Epoch AI evaluation · epoch-run Run: 2025-08-07 · gpqa_diamond.csv Reported standard error: ±2.13 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-2025-02-28-PrivateReasoning | 32.41%gpt-5-2025-08-07_high Epoch AI evaluation · epoch-run Run: 2025-11-13 · frontiermath.csv Reported standard error: ±2.75 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-2025-02-28-PrivateReasoning | 27.24%gpt-5-2025-08-07_medium Epoch AI evaluation · epoch-run Run: 2025-11-13 · frontiermath.csv Reported standard error: ±2.62 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tier-4-2025-07-01-PrivateReasoning | 12.50%gpt-5-2025-08-07_high Epoch AI evaluation · epoch-run Run: 2025-10-30 · frontiermath_tier_4.csv Reported standard error: ±4.82 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tier-4-2025-07-01-PrivateReasoning | 6.25%gpt-5-2025-08-07_medium Epoch AI evaluation · epoch-run Run: 2025-08-07 · frontiermath_tier_4.csv Reported standard error: ±3.53 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tiers-1-3-v2-PrivateReasoning | 37.19%gpt-5-2025-08-07_low Epoch AI evaluation · epoch-run Run: 2026-08-27 · frontiermath_tiers_1_3_v2.csv Reported standard error: ±2.87 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | low / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tiers-1-3-v2-PrivateReasoning | 18.25%gpt-5-2025-08-07_minimal Epoch AI evaluation · epoch-run Run: 2026-08-27 · frontiermath_tiers_1_3_v2.csv Reported standard error: ±2.29 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | minimal / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tiers-1-3-v2-PrivateReasoning | 55.44%gpt-5-2025-08-07_high Epoch AI evaluation · epoch-run Run: 2026-06-10 · frontiermath_tiers_1_3_v2.csv Reported standard error: ±2.95 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tier-4-v2-PrivateReasoning | 21.95%gpt-5-2025-08-07_high Epoch AI evaluation · epoch-run Run: 2026-06-11 · frontiermath_tier_4_v2.csv Reported standard error: ±6.54 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| MATH level 5Reasoning | 98.13%gpt-5-2025-08-07_high Epoch AI evaluation · epoch-run Run: 2025-10-29 · math_level_5.csv Reported standard error: ±0.32 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| MATH level 5Reasoning | 97.92%gpt-5-2025-08-07_medium Epoch AI evaluation · epoch-run Run: 2025-08-20 · math_level_5.csv Reported standard error: ±0.34 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 46.67%gpt-5-2025-08-07_minimal Epoch AI evaluation · epoch-run Run: 2026-07-20 · otis_mock_aime_2024_2025.csv Reported standard error: ±7.52 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | minimal / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 91.39%gpt-5-2025-08-07_high Epoch AI evaluation · epoch-run Run: 2025-10-29 · otis_mock_aime_2024_2025.csv Reported standard error: ±3.66 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 87.22%gpt-5-2025-08-07_medium Epoch AI evaluation · epoch-run Run: 2025-08-07 · otis_mock_aime_2024_2025.csv Reported standard error: ±3.88 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Epoch Inspect | Epoch AI run ↗ |
|---|
| SWE-Bench verifiedCoding | 73.55%gpt-5-2025-08-07_high Epoch AI evaluation · epoch-run Run: 2026-02-06 · swe_bench_verified.csv Reported standard error: ±2.01 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| SWE-Bench verifiedCoding | 71.49%gpt-5-2025-08-07_medium Epoch AI evaluation · epoch-run Run: 2026-02-05 · swe_bench_verified.csv Reported standard error: ±2.05 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Epoch Inspect | Epoch AI run ↗ |
|---|
| SimpleQA VerifiedKnowledge | 50.10%gpt-5-2025-08-07_high Epoch AI evaluation · epoch-run Run: 2026-08-27 · simpleqa_verified.csv Reported standard error: ±1.58 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| Chess PuzzlesReasoning | 36.00%gpt-5-2025-08-07_high Epoch AI evaluation · epoch-run Run: 2026-10-13 · chess_puzzles.csv Reported standard error: ±4.82 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| Chess PuzzlesReasoning | 32.00%gpt-5-2025-08-07_medium Epoch AI evaluation · epoch-run Run: 2026-10-13 · chess_puzzles.csv Reported standard error: ±4.69 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Epoch Inspect | Epoch AI run ↗ |
|---|
| Chess PuzzlesReasoning | 27.00%gpt-5-2025-08-07_low Epoch AI evaluation · epoch-run Run: 2026-10-13 · chess_puzzles.csv Reported standard error: ±4.46 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | low / Epoch Inspect | Epoch AI run ↗ |
|---|
| Chess PuzzlesReasoning | 11.00%gpt-5-2025-08-07_minimal Epoch AI evaluation · epoch-run Run: 2026-10-13 · chess_puzzles.csv Reported standard error: ±3.14 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | minimal / Epoch Inspect | Epoch AI run ↗ |
|---|
| EBR-benchOther | 12.70%gpt-5-2025-08-07_high Epoch AI evaluation · epoch-run Run: 2026-06-29 · ebr_bench.csv Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| Mystery Game PuzzlesReasoning | 15.00%gpt-5-2025-08-07_medium Epoch AI evaluation · epoch-run Run: 2026-08-27 · mystery_game_puzzles.csv Reported standard error: ±3.59 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Epoch Inspect | Epoch AI run ↗ |
|---|
| Mystery Game PuzzlesReasoning | 16.00%gpt-5-2025-08-07_low Epoch AI evaluation · epoch-run Run: 2026-08-27 · mystery_game_puzzles.csv Reported standard error: ±3.68 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | low / Epoch Inspect | Epoch AI run ↗ |
|---|
| Mystery Game PuzzlesReasoning | 14.00%gpt-5-2025-08-07_minimal Epoch AI evaluation · epoch-run Run: 2026-08-27 · mystery_game_puzzles.csv Reported standard error: ±3.49 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | minimal / Epoch Inspect | Epoch AI run ↗ |
|---|
| Mystery Game PuzzlesReasoning | 23.00%gpt-5-2025-08-07_high Epoch AI evaluation · epoch-run Run: 2026-08-05 · mystery_game_puzzles.csv Reported standard error: ±4.23 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| MirrorCodeCoding | 4.44%gpt-5-2025-08-07_high Epoch AI evaluation · epoch-run Run: 2026-10-21 · mirrorcode.csv Reported standard error: ±3.44 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| Aider polyglotCoding | 81.30%gpt-5-2025-08-07_low https://aider.chat/docs/leaderboards/ · external Run: Date not supplied · aider_polyglot_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| Aider polyglotCoding | 86.70%gpt-5-2025-08-07_medium https://aider.chat/docs/leaderboards/ · external Run: Date not supplied · aider_polyglot_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| Aider polyglotCoding | 88.00%gpt-5-2025-08-07_high https://aider.chat/docs/leaderboards/ · external Run: Date not supplied · aider_polyglot_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 65.67%gpt-5-2025-08-07_high https://arcprize.org/leaderboard · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 56.17%gpt-5-2025-08-07_medium https://arcprize.org/leaderboard · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 44.00%gpt-5-2025-08-07_low ARC Prize Leaderboard · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 6.00%gpt-5-2025-08-07_minimal External result; evaluator not specified · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | minimal / Not reported | External · via Epoch ↗ |
|---|
| BalrogAgents | 32.80%gpt-5-2025-08-07_minimal https://balrogai.com/ · external Run: Date not supplied · balrog_external.csv Inspect source ↗CC BY 4.0 | minimal / Not reported | External · via Epoch ↗ |
|---|
| DeepResearch BenchAgents | 49.60%gpt-5-2025-08-07_low https://evals.futuresearch.ai/#drb · external Run: Date not supplied · deepresearchbench_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| DeepResearch BenchAgents | 48.90%gpt-5-2025-08-07_minimal https://evals.futuresearch.ai/#drb · external Run: Date not supplied · deepresearchbench_external.csv Inspect source ↗CC BY 4.0 | minimal / Not reported | External · via Epoch ↗ |
|---|
| DeepResearch BenchAgents | 48.60%gpt-5-2025-08-07_medium https://evals.futuresearch.ai/#drb · external Run: Date not supplied · deepresearchbench_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| DeepResearch BenchAgents | 48.10%gpt-5-2025-08-07_high https://evals.futuresearch.ai/#drb · external Run: Date not supplied · deepresearchbench_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| Fiction.LiveBenchOther | 97.20%gpt-5-2025-08-07_medium Fiction.live leaderboard · external Run: Date not supplied · fictionlivebench_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| GeoBenchOther | 81.00%gpt-5-2025-08-07_medium GeoBench leaderboard · external Run: Date not supplied · geobench_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| GSO-BenchCoding | 6.86%gpt-5-2025-08-07_high https://gso-bench.github.io/index.html · external Run: Date not supplied · gso_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| SimpleBenchReasoning | 56.70%gpt-5-2025-08-07_high https://lmcouncil.ai/benchmarks · external Run: Date not supplied · simplebench_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 49.61%gpt-5-2025-08-07_unknown https://www.tbench.ai/leaderboard/terminal-bench/2.0 · external Run: 2025-08-07 · terminalbench_external.csv Reported standard error: ±2.90 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / Codex CLI | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 49.60%gpt-5-2025-08-07_medium Terminal-Bench v2 Leaderboard · external Run: 2025-11-04 · terminalbench_external.csv Reported standard error: ±2.90 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Codex CLI | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 43.82%gpt-5-2025-08-07_unknown https://www.tbench.ai/leaderboard/terminal-bench/2.0 · external Run: 2025-08-07 · terminalbench_external.csv Reported standard error: ±2.99 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / OpenHands | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 43.80%gpt-5-2025-08-07_medium Terminal-Bench v2 Leaderboard · external Run: 2025-11-02 · terminalbench_external.csv Reported standard error: ±3.00 pp. This is not a 90% interval. Medium thinking used in other GPT-5 evaluations, assuming the same here. Inspect source ↗CC BY 4.0 | medium / OpenHands | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 35.20%gpt-5-2025-08-07_medium Terminal-Bench v2 Leaderboard · external Run: 2025-10-31 · terminalbench_external.csv Reported standard error: ±3.10 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Terminus 2 | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 35.17%gpt-5-2025-08-07_unknown https://www.tbench.ai/leaderboard/terminal-bench/2.0 · external Run: 2025-08-07 · terminalbench_external.csv Reported standard error: ±3.06 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / Terminus 2 | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 33.93%gpt-5-2025-08-07_unknown https://www.tbench.ai/leaderboard/terminal-bench/2.0 · external Run: 2025-08-07 · terminalbench_external.csv Reported standard error: ±2.90 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / Mini-SWE-Agent | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 33.90%gpt-5-2025-08-07_medium Terminal-Bench v2 Leaderboard · external Run: 2025-11-03 · terminalbench_external.csv Reported standard error: ±2.90 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Mini-SWE-Agent | External · via Epoch ↗ |
|---|
| VPCTOther | 66.00%gpt-5-2025-08-07_high VPCT leaderboard · external Run: Date not supplied · vpct_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| VPCTOther | 63.20%gpt-5-2025-08-07_medium VPCT leaderboard · external Run: Date not supplied · vpct_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| WeirdMLCoding | 60.70%gpt-5-2025-08-07_high https://htihle.github.io/weirdml.html · external Run: Date not supplied · weirdml_external.csv Reported standard error: ±0.02 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| WeirdMLCoding | 39.77%gpt-5-chat https://htihle.github.io/weirdml.html · external Run: Date not supplied · weirdml_external.csv Reported standard error: ±0.01 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 9.86%gpt-5-2025-08-07_high External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 7.49%gpt-5-2025-08-07_medium External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 1.94%gpt-5-2025-08-07_low External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 1.94%gpt-5-2025-08-07_low External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 0.00%gpt-5-2025-08-07_minimal External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | minimal / Not reported | External · via Epoch ↗ |
|---|
| HLEKnowledge | 25.32%gpt-5-2025-08-07_high External result; evaluator not specified · external Run: Date not supplied · hle_external.csv Reported standard error: ±1.70 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| HLEKnowledge | 25.32%gpt-5-2025-08-07_unknown External result; evaluator not specified · external Run: Date not supplied · hle_external.csv Reported standard error: ±1.70 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| CritPtOther | 12.60%gpt-5-2025-08-07_high External result; evaluator not specified · external Run: Date not supplied · critpt_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| CritPtOther | 0.00%gpt-5-2025-08-07_minimal External result; evaluator not specified · external Run: Date not supplied · critpt_external.csv Inspect source ↗CC BY 4.0 | minimal / Not reported | External · via Epoch ↗ |
|---|
| Remote Labor IndexAgents | 1.67%gpt-5-2025-08-07_unknown External result; evaluator not specified · external Run: Date not supplied · rli_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| GDPvalAgents | 34.80%gpt-5-2025-08-07_medium External result; evaluator not specified · external Run: Date not supplied · gdpval_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| METR Time HorizonsOther | 69.37%gpt-5-2025-08-07_high External result; evaluator not specified · external Run: Date not supplied · metr_time_horizons_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| METR Time HorizonsOther | 69.61%gpt-5-2025-08-07_medium METR - Measuring AI Ability to Complete Long Tasks · external Run: Date not supplied · metr_time_horizons_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| ProofBenchReasoning | 18.00%gpt-5-2025-08-07_high https://www.vals.ai/benchmarks/proof_bench · external Run: Date not supplied · proofbench_external.csv Reported standard error: ±3.84 pp. This is not a 90% interval. ProofBench v1.0-era value; model absent from the v1.1 board (vals.ai re-grade 2026-08-14, methodology changed) and not re-run. Not comparable to v1.1 rows. Annotated 2026-08-18. Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| LMCAReasoning | 39.99%gpt-5-2025-08-07_high https://conceptualreasoning.ai/lmca · external Run: Date not supplied · lmca_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| DTBenchReasoning | 90.67%gpt-5-2025-08-07_high https://conceptualreasoning.ai/dtbench · external Run: Date not supplied · dtbench_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| EnigmaEvalOther | 10.47%gpt-5-2025-08-07_unknown https://labs.scale.com/leaderboard/enigma_eval · external Run: Date not supplied · enigma_eval_external.csv Reported standard error: ±1.74 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|