| GPQA diamondKnowledge | 57.58%gpt-5-nano-2025-08-07_low Epoch AI evaluation · epoch-run Run: 2026-07-13 · gpqa_diamond.csv Reported standard error: ±3.52 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | low / Epoch Inspect | Epoch AI run ↗ |
|---|
| GPQA diamondKnowledge | 48.48%gpt-5-nano-2025-08-07_minimal Epoch AI evaluation · epoch-run Run: 2026-07-13 · gpqa_diamond.csv Reported standard error: ±3.56 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | minimal / Epoch Inspect | Epoch AI run ↗ |
|---|
| GPQA diamondKnowledge | 69.44%gpt-5-nano-2025-08-07_high Epoch AI evaluation · epoch-run Run: 2025-10-30 · gpqa_diamond.csv Reported standard error: ±2.76 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| GPQA diamondKnowledge | 67.42%gpt-5-nano-2025-08-07_medium Epoch AI evaluation · epoch-run Run: 2025-08-07 · gpqa_diamond.csv Reported standard error: ±2.66 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-2025-02-28-PrivateReasoning | 8.28%gpt-5-nano-2025-08-07_high Epoch AI evaluation · epoch-run Run: 2025-10-30 · frontiermath.csv Reported standard error: ±1.62 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-2025-02-28-PrivateReasoning | 7.24%gpt-5-nano-2025-08-07_medium Epoch AI evaluation · epoch-run Run: 2025-08-07 · frontiermath.csv Reported standard error: ±1.52 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tier-4-2025-07-01-PrivateReasoning | 0.00%gpt-5-nano-2025-08-07_high Epoch AI evaluation · epoch-run Run: 2025-10-30 · frontiermath_tier_4.csv Reported standard error: ±0.00 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tier-4-2025-07-01-PrivateReasoning | 2.08%gpt-5-nano-2025-08-07_medium Epoch AI evaluation · epoch-run Run: 2025-08-07 · frontiermath_tier_4.csv Reported standard error: ±2.08 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tiers-1-3-v2-PrivateReasoning | 1.75%gpt-5-nano-2025-08-07_minimal Epoch AI evaluation · epoch-run Run: 2026-08-27 · frontiermath_tiers_1_3_v2.csv Reported standard error: ±0.78 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | minimal / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tiers-1-3-v2-PrivateReasoning | 5.96%gpt-5-nano-2025-08-07_low Epoch AI evaluation · epoch-run Run: 2026-08-27 · frontiermath_tiers_1_3_v2.csv Reported standard error: ±1.41 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | low / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tiers-1-3-v2-PrivateReasoning | 20.00%gpt-5-nano-2025-08-07_high Epoch AI evaluation · epoch-run Run: 2026-06-12 · frontiermath_tiers_1_3_v2.csv Reported standard error: ±2.37 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tier-4-v2-PrivateReasoning | 2.44%gpt-5-nano-2025-08-07_high Epoch AI evaluation · epoch-run Run: 2026-06-12 · frontiermath_tier_4_v2.csv Reported standard error: ±2.44 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| MATH level 5Reasoning | 95.24%gpt-5-nano-2025-08-07_medium Epoch AI evaluation · epoch-run Run: 2025-08-20 · math_level_5.csv Reported standard error: ±0.46 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Epoch Inspect | Epoch AI run ↗ |
|---|
| MATH level 5Reasoning | 94.90%gpt-5-nano-2025-08-07_high Epoch AI evaluation · epoch-run Run: 2025-08-20 · math_level_5.csv Reported standard error: ±0.48 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 46.67%gpt-5-nano-2025-08-07_low Epoch AI evaluation · epoch-run Run: 2026-07-13 · otis_mock_aime_2024_2025.csv Reported standard error: ±7.52 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | low / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 35.56%gpt-5-nano-2025-08-07_minimal Epoch AI evaluation · epoch-run Run: 2026-07-13 · otis_mock_aime_2024_2025.csv Reported standard error: ±7.22 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | minimal / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 81.11%gpt-5-nano-2025-08-07_high Epoch AI evaluation · epoch-run Run: 2025-10-31 · otis_mock_aime_2024_2025.csv Reported standard error: ±4.63 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 74.17%gpt-5-nano-2025-08-07_medium Epoch AI evaluation · epoch-run Run: 2025-08-07 · otis_mock_aime_2024_2025.csv Reported standard error: ±5.23 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Epoch Inspect | Epoch AI run ↗ |
|---|
| SimpleQA VerifiedKnowledge | 11.70%gpt-5-nano-2025-08-07_high Epoch AI evaluation · epoch-run Run: 2026-08-10 · simpleqa_verified.csv Reported standard error: ±1.02 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| Chess PuzzlesReasoning | 22.00%gpt-5-nano-2025-08-07_high Epoch AI evaluation · epoch-run Run: 2026-10-13 · chess_puzzles.csv Reported standard error: ±4.16 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| Chess PuzzlesReasoning | 15.00%gpt-5-nano-2025-08-07_low Epoch AI evaluation · epoch-run Run: 2026-10-13 · chess_puzzles.csv Reported standard error: ±3.59 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | low / Epoch Inspect | Epoch AI run ↗ |
|---|
| Chess PuzzlesReasoning | 2.00%gpt-5-nano-2025-08-07_minimal Epoch AI evaluation · epoch-run Run: 2026-10-13 · chess_puzzles.csv Reported standard error: ±1.41 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | minimal / Epoch Inspect | Epoch AI run ↗ |
|---|
| Mystery Game PuzzlesReasoning | 8.00%gpt-5-nano-2025-08-07_high Epoch AI evaluation · epoch-run Run: 2026-08-27 · mystery_game_puzzles.csv Reported standard error: ±2.73 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| Mystery Game PuzzlesReasoning | 9.00%gpt-5-nano-2025-08-07_medium Epoch AI evaluation · epoch-run Run: 2026-08-27 · mystery_game_puzzles.csv Reported standard error: ±2.88 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Epoch Inspect | Epoch AI run ↗ |
|---|
| Mystery Game PuzzlesReasoning | 9.00%gpt-5-nano-2025-08-07_low Epoch AI evaluation · epoch-run Run: 2026-08-27 · mystery_game_puzzles.csv Reported standard error: ±2.88 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | low / Epoch Inspect | Epoch AI run ↗ |
|---|
| Mystery Game PuzzlesReasoning | 5.00%gpt-5-nano-2025-08-07_minimal Epoch AI evaluation · epoch-run Run: 2026-08-27 · mystery_game_puzzles.csv Reported standard error: ±2.19 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | minimal / Epoch Inspect | Epoch AI run ↗ |
|---|
| ARC-AGIReasoning | 20.71%gpt-5-nano-2025-08-07_medium External result; evaluator not specified · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 16.67%gpt-5-nano-2025-08-07_high External result; evaluator not specified · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 4.04%gpt-5-nano-2025-08-07_low External result; evaluator not specified · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 1.50%gpt-5-nano-2025-08-07_minimal External result; evaluator not specified · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | minimal / Not reported | External · via Epoch ↗ |
|---|
| Fiction.LiveBenchOther | 44.40%gpt-5-nano-2025-08-07_medium Fiction.live leaderboard · external Run: Date not supplied · fictionlivebench_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 21.80%gpt-5-nano-2025-08-07_unknown https://www.tbench.ai/leaderboard/terminal-bench/2.0 · external Run: 2025-08-07 · terminalbench_external.csv Reported standard error: ±2.80 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / spoox-o-m | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 11.50%gpt-5-nano-2025-08-07_medium Terminal-Bench v2 Leaderboard · external Run: 2025-11-04 · terminalbench_external.csv Reported standard error: ±2.30 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Codex CLI | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 11.46%gpt-5-nano-2025-08-07_unknown https://www.tbench.ai/leaderboard/terminal-bench/2.0 · external Run: 2025-08-07 · terminalbench_external.csv Reported standard error: ±2.27 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / Codex CLI | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 9.90%gpt-5-nano-2025-08-07_medium Terminal-Bench v2 Leaderboard · external Run: 2025-11-02 · terminalbench_external.csv Reported standard error: ±2.10 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / OpenHands | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 9.89%gpt-5-nano-2025-08-07_unknown https://www.tbench.ai/leaderboard/terminal-bench/2.0 · external Run: 2025-08-07 · terminalbench_external.csv Reported standard error: ±2.11 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / OpenHands | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 7.90%gpt-5-nano-2025-08-07_medium Terminal-Bench v2 Leaderboard · external Run: 2025-10-31 · terminalbench_external.csv Reported standard error: ±1.90 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Terminus 2 | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 7.87%gpt-5-nano-2025-08-07_unknown https://www.tbench.ai/leaderboard/terminal-bench/2.0 · external Run: 2025-08-07 · terminalbench_external.csv Reported standard error: ±1.87 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / Terminus 2 | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 7.00%gpt-5-nano-2025-08-07_medium Terminal-Bench v2 Leaderboard · external Run: 2025-11-03 · terminalbench_external.csv Reported standard error: ±1.90 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Mini-SWE-Agent | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 6.97%gpt-5-nano-2025-08-07_unknown https://www.tbench.ai/leaderboard/terminal-bench/2.0 · external Run: 2025-08-07 · terminalbench_external.csv Reported standard error: ±1.92 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / Mini-SWE-Agent | External · via Epoch ↗ |
|---|
| VPCTOther | 37.20%gpt-5-nano-2025-08-07_high VPCT leaderboard · external Run: Date not supplied · vpct_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| VPCTOther | 35.40%gpt-5-nano-2025-08-07_medium VPCT leaderboard · external Run: Date not supplied · vpct_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| WeirdMLCoding | 38.06%gpt-5-nano-2025-08-07_high https://htihle.github.io/weirdml.html · external Run: Date not supplied · weirdml_external.csv Reported standard error: ±0.01 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| WeirdMLCoding | 25.89%gpt-5-nano-2025-08-07_low https://htihle.github.io/weirdml.html · external Run: Date not supplied · weirdml_external.csv Reported standard error: ±0.01 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 2.61%gpt-5-nano-2025-08-07_high External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 0.88%gpt-5-nano-2025-08-07_medium External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 0.00%gpt-5-nano-2025-08-07_low External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 0.00%gpt-5-nano-2025-08-07_minimal External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | minimal / Not reported | External · via Epoch ↗ |
|---|
| ProofBenchReasoning | 12.00%gpt-5-nano-2025-08-07_high https://www.vals.ai/benchmarks/proof_bench · external Run: Date not supplied · proofbench_external.csv Reported standard error: ±3.25 pp. This is not a 90% interval. ProofBench v1.0-era value; model absent from the v1.1 board (vals.ai re-grade 2026-08-14, methodology changed) and not re-run. Not comparable to v1.1 rows. Annotated 2026-08-18. Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| LMCAReasoning | 7.93%gpt-5-nano-2025-08-07_high https://conceptualreasoning.ai/lmca · external Run: Date not supplied · lmca_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| DTBenchReasoning | 62.67%gpt-5-nano-2025-08-07_high https://conceptualreasoning.ai/dtbench · external Run: Date not supplied · dtbench_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|