| GPQA diamondKnowledge | 71.72%gpt-5-mini-2025-08-07_minimal Epoch AI evaluation · epoch-run Run: 2026-08-07 · gpqa_diamond.csv Reported standard error: ±3.21 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | minimal / Epoch Inspect | Epoch AI run ↗ |
|---|
| GPQA diamondKnowledge | 75.00%gpt-5-mini-2025-08-07_high Epoch AI evaluation · epoch-run Run: 2025-10-30 · gpqa_diamond.csv Reported standard error: ±2.28 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| GPQA diamondKnowledge | 71.65%gpt-5-mini-2025-08-07_medium Epoch AI evaluation · epoch-run Run: 2025-08-07 · gpqa_diamond.csv Reported standard error: ±2.32 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-2025-02-28-PrivateReasoning | 27.24%gpt-5-mini-2025-08-07_high Epoch AI evaluation · epoch-run Run: 2025-11-13 · frontiermath.csv Reported standard error: ±2.62 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-2025-02-28-PrivateReasoning | 20.34%gpt-5-mini-2025-08-07_medium Epoch AI evaluation · epoch-run Run: 2025-11-13 · frontiermath.csv Reported standard error: ±2.37 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tier-4-2025-07-01-PrivateReasoning | 6.25%gpt-5-mini-2025-08-07_high Epoch AI evaluation · epoch-run Run: 2025-10-30 · frontiermath_tier_4.csv Reported standard error: ±3.53 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tier-4-2025-07-01-PrivateReasoning | 4.17%gpt-5-mini-2025-08-07_medium Epoch AI evaluation · epoch-run Run: 2025-08-07 · frontiermath_tier_4.csv Reported standard error: ±2.91 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tiers-1-3-v2-PrivateReasoning | 5.96%gpt-5-mini-2025-08-07_minimal Epoch AI evaluation · epoch-run Run: 2026-08-27 · frontiermath_tiers_1_3_v2.csv Reported standard error: ±1.41 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | minimal / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tiers-1-3-v2-PrivateReasoning | 18.25%gpt-5-mini-2025-08-07_low Epoch AI evaluation · epoch-run Run: 2026-08-27 · frontiermath_tiers_1_3_v2.csv Reported standard error: ±2.29 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | low / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tiers-1-3-v2-PrivateReasoning | 46.67%gpt-5-mini-2025-08-07_high Epoch AI evaluation · epoch-run Run: 2026-06-12 · frontiermath_tiers_1_3_v2.csv Reported standard error: ±2.96 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tier-4-v2-PrivateReasoning | 12.20%gpt-5-mini-2025-08-07_high Epoch AI evaluation · epoch-run Run: 2026-06-12 · frontiermath_tier_4_v2.csv Reported standard error: ±5.17 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| MATH level 5Reasoning | 97.85%gpt-5-mini-2025-08-07_high Epoch AI evaluation · epoch-run Run: 2025-10-30 · math_level_5.csv Reported standard error: ±0.34 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| MATH level 5Reasoning | 96.79%gpt-5-mini-2025-08-07_medium Epoch AI evaluation · epoch-run Run: 2025-08-20 · math_level_5.csv Reported standard error: ±0.39 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 55.56%gpt-5-mini-2025-08-07_minimal Epoch AI evaluation · epoch-run Run: 2026-08-07 · otis_mock_aime_2024_2025.csv Reported standard error: ±7.49 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | minimal / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 86.67%gpt-5-mini-2025-08-07_high Epoch AI evaluation · epoch-run Run: 2025-10-30 · otis_mock_aime_2024_2025.csv Reported standard error: ±4.29 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 78.33%gpt-5-mini-2025-08-07_medium Epoch AI evaluation · epoch-run Run: 2025-08-07 · otis_mock_aime_2024_2025.csv Reported standard error: ±4.79 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Epoch Inspect | Epoch AI run ↗ |
|---|
| SWE-Bench verifiedCoding | 64.67%gpt-5-mini-2025-08-07_medium Epoch AI evaluation · epoch-run Run: 2026-02-01 · swe_bench_verified.csv Reported standard error: ±2.17 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Epoch Inspect | Epoch AI run ↗ |
|---|
| SimpleQA VerifiedKnowledge | 21.60%gpt-5-mini-2025-08-07_high Epoch AI evaluation · epoch-run Run: 2026-08-10 · simpleqa_verified.csv Reported standard error: ±1.30 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| Chess PuzzlesReasoning | 16.00%gpt-5-mini-2025-08-07_low Epoch AI evaluation · epoch-run Run: 2026-10-13 · chess_puzzles.csv Reported standard error: ±3.68 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | low / Epoch Inspect | Epoch AI run ↗ |
|---|
| Chess PuzzlesReasoning | 24.00%gpt-5-mini-2025-08-07_high Epoch AI evaluation · epoch-run Run: 2026-10-13 · chess_puzzles.csv Reported standard error: ±4.29 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| Chess PuzzlesReasoning | 0.00%gpt-5-mini-2025-08-07_minimal Epoch AI evaluation · epoch-run Run: 2026-10-13 · chess_puzzles.csv Reported standard error: ±0.00 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | minimal / Epoch Inspect | Epoch AI run ↗ |
|---|
| Mystery Game PuzzlesReasoning | 5.00%gpt-5-mini-2025-08-07_high Epoch AI evaluation · epoch-run Run: 2026-08-27 · mystery_game_puzzles.csv Reported standard error: ±2.19 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| Mystery Game PuzzlesReasoning | 4.00%gpt-5-mini-2025-08-07_medium Epoch AI evaluation · epoch-run Run: 2026-08-27 · mystery_game_puzzles.csv Reported standard error: ±1.97 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Epoch Inspect | Epoch AI run ↗ |
|---|
| Mystery Game PuzzlesReasoning | 10.00%gpt-5-mini-2025-08-07_minimal Epoch AI evaluation · epoch-run Run: 2026-08-27 · mystery_game_puzzles.csv Reported standard error: ±3.02 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | minimal / Epoch Inspect | Epoch AI run ↗ |
|---|
| ARC-AGIReasoning | 54.33%gpt-5-mini-2025-08-07_high External result; evaluator not specified · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 37.33%gpt-5-mini-2025-08-07_medium External result; evaluator not specified · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 26.33%gpt-5-mini-2025-08-07_low External result; evaluator not specified · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 5.33%gpt-5-mini-2025-08-07_minimal External result; evaluator not specified · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | minimal / Not reported | External · via Epoch ↗ |
|---|
| Fiction.LiveBenchOther | 69.40%gpt-5-mini-2025-08-07_medium Fiction.live leaderboard · external Run: Date not supplied · fictionlivebench_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 34.83%gpt-5-mini-2025-08-07_unknown https://www.tbench.ai/leaderboard/terminal-bench/2.0 · external Run: 2025-08-07 · terminalbench_external.csv Reported standard error: ±2.72 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / spoox-o-m | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 34.80%gpt-5-mini-2025-08-07_unknown External result; evaluator not specified · external Run: 2025-12-24 · terminalbench_external.csv Reported standard error: ±2.70 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / spoox-m | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 31.90%gpt-5-mini-2025-08-07_medium Terminal-Bench v2 Leaderboard · external Run: 2025-11-04 · terminalbench_external.csv Reported standard error: ±3.00 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Codex CLI | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 31.85%gpt-5-mini-2025-08-07_unknown https://www.tbench.ai/leaderboard/terminal-bench/2.0 · external Run: 2025-08-07 · terminalbench_external.csv Reported standard error: ±3.00 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / Codex CLI | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 29.21%gpt-5-mini-2025-08-07_unknown https://www.tbench.ai/leaderboard/terminal-bench/2.0 · external Run: 2025-08-07 · terminalbench_external.csv Reported standard error: ±2.75 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / OpenHands | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 29.20%gpt-5-mini-2025-08-07_medium Terminal-Bench v2 Leaderboard · external Run: 2025-11-02 · terminalbench_external.csv Reported standard error: ±2.80 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / OpenHands | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 24.04%gpt-5-mini-2025-08-07_unknown https://www.tbench.ai/leaderboard/terminal-bench/2.0 · external Run: 2025-08-07 · terminalbench_external.csv Reported standard error: ±2.53 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / Terminus 2 | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 24.00%gpt-5-mini-2025-08-07_medium Terminal-Bench v2 Leaderboard · external Run: 2025-10-31 · terminalbench_external.csv Reported standard error: ±2.50 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Terminus 2 | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 22.25%gpt-5-mini-2025-08-07_unknown https://www.tbench.ai/leaderboard/terminal-bench/2.0 · external Run: 2025-08-07 · terminalbench_external.csv Reported standard error: ±2.62 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / Mini-SWE-Agent | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 22.20%gpt-5-mini-2025-08-07_medium Terminal-Bench v2 Leaderboard · external Run: 2025-11-03 · terminalbench_external.csv Reported standard error: ±2.60 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Mini-SWE-Agent | External · via Epoch ↗ |
|---|
| VPCTOther | 40.20%gpt-5-mini-2025-08-07_medium VPCT leaderboard · external Run: Date not supplied · vpct_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| VPCTOther | 39.00%gpt-5-mini-2025-08-07_high VPCT leaderboard · external Run: Date not supplied · vpct_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| WeirdMLCoding | 52.67%gpt-5-mini-2025-08-07_high https://htihle.github.io/weirdml.html · external Run: Date not supplied · weirdml_external.csv Reported standard error: ±0.01 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 4.44%gpt-5-mini-2025-08-07_high External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 4.03%gpt-5-mini-2025-08-07_medium External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 1.67%gpt-5-mini-2025-08-07_minimal External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | minimal / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 0.83%gpt-5-mini-2025-08-07_low External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| HLEKnowledge | 19.44%gpt-5-mini-2025-08-07_unknown External result; evaluator not specified · external Run: Date not supplied · hle_external.csv Reported standard error: ±1.55 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| CritPtOther | 0.00%gpt-5-mini-2025-08-07_unknown External result; evaluator not specified · external Run: Date not supplied · critpt_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| CritPtOther | 0.00%gpt-5-mini-2025-08-07_high External result; evaluator not specified · external Run: Date not supplied · critpt_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| ProofBenchReasoning | 9.00%gpt-5-mini-2025-08-07_high https://www.vals.ai/benchmarks/proof_bench · external Run: Date not supplied · proofbench_external.csv Reported standard error: ±2.86 pp. This is not a 90% interval. ProofBench v1.0-era value; model absent from the v1.1 board (vals.ai re-grade 2026-08-14, methodology changed) and not re-run. Not comparable to v1.1 rows. Annotated 2026-08-18. Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| LMCAReasoning | 34.20%gpt-5-mini-2025-08-07_high https://conceptualreasoning.ai/lmca · external Run: Date not supplied · lmca_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| DTBenchReasoning | 80.53%gpt-5-mini-2025-08-07_high https://conceptualreasoning.ai/dtbench · external Run: Date not supplied · dtbench_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| EnigmaEvalOther | 8.19%gpt-5-mini-2025-08-07_unknown https://labs.scale.com/leaderboard/enigma_eval · external Run: Date not supplied · enigma_eval_external.csv Reported standard error: ±1.56 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|