| GPQA diamondKnowledge | 66.67%gpt-5.1-2025-11-13_none Epoch AI evaluation · epoch-run Run: 2026-08-07 · gpqa_diamond.csv Reported standard error: ±3.36 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | none / Epoch Inspect | Epoch AI run ↗ |
|---|
| GPQA diamondKnowledge | 85.04%gpt-5.1-2025-11-13_medium Epoch AI evaluation · epoch-run Run: 2025-11-17 · gpqa_diamond.csv Reported standard error: ±2.13 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Epoch Inspect | Epoch AI run ↗ |
|---|
| GPQA diamondKnowledge | 87.63%gpt-5.1-2025-11-13_high Epoch AI evaluation · epoch-run Run: 2025-11-13 · gpqa_diamond.csv Reported standard error: ±1.88 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-2025-02-28-PrivateReasoning | 2.10%gpt-5.1-2025-11-13_none Epoch AI evaluation · epoch-run Run: 2025-11-25 · frontiermath.csv Reported standard error: ±0.85 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | none / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-2025-02-28-PrivateReasoning | 17.30%gpt-5.1-2025-11-13_low Epoch AI evaluation · epoch-run Run: 2025-11-25 · frontiermath.csv Reported standard error: ±2.23 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | low / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-2025-02-28-PrivateReasoning | 26.90%gpt-5.1-2025-11-13_medium Epoch AI evaluation · epoch-run Run: 2025-11-17 · frontiermath.csv Reported standard error: ±2.61 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-2025-02-28-PrivateReasoning | 31.03%gpt-5.1-2025-11-13_high Epoch AI evaluation · epoch-run Run: 2025-11-13 · frontiermath.csv Reported standard error: ±2.72 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tier-4-2025-07-01-PrivateReasoning | 4.17%gpt-5.1-2025-11-13_medium Epoch AI evaluation · epoch-run Run: 2025-11-17 · frontiermath_tier_4.csv Reported standard error: ±2.91 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tier-4-2025-07-01-PrivateReasoning | 12.50%gpt-5.1-2025-11-13_high Epoch AI evaluation · epoch-run Run: 2025-11-13 · frontiermath_tier_4.csv Reported standard error: ±4.82 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 37.78%gpt-5.1-2025-11-13_none Epoch AI evaluation · epoch-run Run: 2026-08-07 · otis_mock_aime_2024_2025.csv Reported standard error: ±7.31 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | none / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 63.89%gpt-5.1-2025-11-13_low Epoch AI evaluation · epoch-run Run: 2025-11-25 · otis_mock_aime_2024_2025.csv Reported standard error: ±5.88 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | low / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 85.56%gpt-5.1-2025-11-13_medium Epoch AI evaluation · epoch-run Run: 2025-11-17 · otis_mock_aime_2024_2025.csv Reported standard error: ±4.39 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 88.61%gpt-5.1-2025-11-13_high Epoch AI evaluation · epoch-run Run: 2025-11-13 · otis_mock_aime_2024_2025.csv Reported standard error: ±4.05 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| SWE-Bench verifiedCoding | 67.98%gpt-5.1-2025-11-13_high Epoch AI evaluation · epoch-run Run: 2026-02-18 · swe_bench_verified.csv Reported standard error: ±2.12 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| SWE-Bench verifiedCoding | 65.91%gpt-5.1-2025-11-13_high Epoch AI evaluation · epoch-run Run: 2026-02-17 · swe_bench_verified.csv Reported standard error: ±2.16 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| SimpleQA VerifiedKnowledge | 48.00%gpt-5.1-2025-11-13_high Epoch AI evaluation · epoch-run Run: 2026-08-27 · simpleqa_verified.csv Reported standard error: ±1.58 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| Chess PuzzlesReasoning | 6.00%gpt-5.1-2025-11-13_none Epoch AI evaluation · epoch-run Run: 2026-10-13 · chess_puzzles.csv Reported standard error: ±2.39 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | none / Epoch Inspect | Epoch AI run ↗ |
|---|
| Chess PuzzlesReasoning | 42.00%gpt-5.1-2025-11-13_high Epoch AI evaluation · epoch-run Run: 2026-10-13 · chess_puzzles.csv Reported standard error: ±4.96 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| Chess PuzzlesReasoning | 23.00%gpt-5.1-2025-11-13_low Epoch AI evaluation · epoch-run Run: 2026-10-13 · chess_puzzles.csv Reported standard error: ±4.23 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | low / Epoch Inspect | Epoch AI run ↗ |
|---|
| Mystery Game PuzzlesReasoning | 16.00%gpt-5.1-2025-11-13_medium Epoch AI evaluation · epoch-run Run: 2026-08-27 · mystery_game_puzzles.csv Reported standard error: ±3.68 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Epoch Inspect | Epoch AI run ↗ |
|---|
| Mystery Game PuzzlesReasoning | 19.00%gpt-5.1-2025-11-13_low Epoch AI evaluation · epoch-run Run: 2026-08-27 · mystery_game_puzzles.csv Reported standard error: ±3.94 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | low / Epoch Inspect | Epoch AI run ↗ |
|---|
| Mystery Game PuzzlesReasoning | 15.00%gpt-5.1-2025-11-13_none Epoch AI evaluation · epoch-run Run: 2026-08-27 · mystery_game_puzzles.csv Reported standard error: ±3.59 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | none / Epoch Inspect | Epoch AI run ↗ |
|---|
| ARC-AGIReasoning | 72.83%gpt-5.1-2025-11-13_high https://arcprize.org/leaderboard · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 72.80%gpt-5.1-2025-11-13_high ARC Prize Leaderboard · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 57.70%gpt-5.1-2025-11-13_medium ARC Prize Leaderboard · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 57.67%gpt-5.1-2025-11-13_medium https://arcprize.org/leaderboard · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 33.17%gpt-5.1-2025-11-13_low External result; evaluator not specified · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 5.83%gpt-5.1-2025-11-13_none External result; evaluator not specified · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | none / Not reported | External · via Epoch ↗ |
|---|
| DeepResearch BenchAgents | 42.80%gpt-5.1-2025-11-13_low https://evals.futuresearch.ai/#drb · external Run: Date not supplied · deepresearchbench_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| GSO-BenchCoding | 13.73%gpt-5.1-2025-11-13_unknown https://gso-bench.github.io/index.html · external Run: Date not supplied · gso_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| GSO-BenchCoding | 13.70%gpt-5.1-2025-11-13_high GSO Leaderboard · external Run: Date not supplied · gso_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| SimpleBenchReasoning | 53.20%gpt-5.1-2025-11-13_high https://lmcouncil.ai/benchmarks · external Run: Date not supplied · simplebench_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 47.60%gpt-5.1-2025-11-13_medium Terminal-Bench v2 Leaderboard · external Run: 2025-11-16 · terminalbench_external.csv Reported standard error: ±2.80 pp. This is not a 90% interval. Assuming medium based on GPT-5 being run at medium. Inspect source ↗CC BY 4.0 | medium / Terminus 2 | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 47.60%gpt-5.1-2025-11-13_medium Terminal-Bench v2 Leaderboard · external Run: 2025-11-16 · terminalbench_external.csv Reported standard error: ±2.80 pp. This is not a 90% interval. Assuming medium based on GPT-5 being run at medium. Inspect source ↗CC BY 4.0 | medium / Terminus 2 | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 47.58%gpt-5.1-2025-11-13_unknown https://www.tbench.ai/leaderboard/terminal-bench/2.0 · external Run: 2025-11-12 · terminalbench_external.csv Reported standard error: ±2.76 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / Terminus 2 | External · via Epoch ↗ |
|---|
| VPCTOther | 58.70%gpt-5.1-2025-11-13_high VPCT leaderboard · external Run: Date not supplied · vpct_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| VPCTOther | 53.30%gpt-5.1-2025-11-13_medium VPCT leaderboard · external Run: Date not supplied · vpct_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| WeirdMLCoding | 60.77%gpt-5.1-2025-11-13_high https://htihle.github.io/weirdml.html · external Run: Date not supplied · weirdml_external.csv Reported standard error: ±0.01 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 17.64%gpt-5.1-2025-11-13_high External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 6.53%gpt-5.1-2025-11-13_medium External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 1.94%gpt-5.1-2025-11-13_low External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 0.42%gpt-5.1-2025-11-13_none External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | none / Not reported | External · via Epoch ↗ |
|---|
| HLEKnowledge | 23.68%gpt-5.1-2025-11-13_unknown External result; evaluator not specified · external Run: Date not supplied · hle_external.csv Reported standard error: ±1.67 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| HLEKnowledge | 6.80%gpt-5.1-2025-11-13_none External result; evaluator not specified · external Run: Date not supplied · hle_external.csv Reported standard error: ±0.99 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | none / Not reported | External · via Epoch ↗ |
|---|
| CritPtOther | 4.86%gpt-5.1-2025-11-13_unknown External result; evaluator not specified · external Run: Date not supplied · critpt_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| CL-benchOther | 23.70%gpt-5.1-2025-11-13_high External result; evaluator not specified · external Run: Date not supplied · cl_bench_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| CL-benchOther | 21.10%gpt-5.1-2025-11-13_unknown External result; evaluator not specified · external Run: Date not supplied · cl_bench_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| CL-bench LifeOther | 17.30%gpt-5.1-2025-11-13_high External result; evaluator not specified · external Run: Date not supplied · cl_bench_life_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| LMCAReasoning | 43.89%gpt-5.1-2025-11-13_high https://conceptualreasoning.ai/lmca · external Run: Date not supplied · lmca_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| DTBenchReasoning | 90.13%gpt-5.1-2025-11-13_high https://conceptualreasoning.ai/dtbench · external Run: Date not supplied · dtbench_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| EnigmaEvalOther | 11.23%gpt-5.1-2025-11-13_unknown https://labs.scale.com/leaderboard/enigma_eval · external Run: Date not supplied · enigma_eval_external.csv Reported standard error: ±1.80 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| EnigmaEvalOther | 1.94%gpt-5.1-2025-11-13_none https://labs.scale.com/leaderboard/enigma_eval · external Run: Date not supplied · enigma_eval_external.csv Reported standard error: ±0.79 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | none / Not reported | External · via Epoch ↗ |
|---|