| GPQA diamondKnowledge | 71.21%claude-haiku-4-5-20251001_32K Epoch AI evaluation · epoch-run Run: 2025-10-22 · gpqa_diamond.csv Reported standard error: ±3.23 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| GPQA diamondKnowledge | 60.48%claude-haiku-4-5-20251001 Epoch AI evaluation · epoch-run Run: 2025-10-16 · gpqa_diamond.csv Reported standard error: ±2.82 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-2025-02-28-PrivateReasoning | 5.90%claude-haiku-4-5-20251001_32K Epoch AI evaluation · epoch-run Run: 2025-10-22 · frontiermath.csv Reported standard error: ±1.39 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-2025-02-28-PrivateReasoning | 4.14%claude-haiku-4-5-20251001 Epoch AI evaluation · epoch-run Run: 2025-10-16 · frontiermath.csv Reported standard error: ±1.17 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tier-4-2025-07-01-PrivateReasoning | 2.08%claude-haiku-4-5-20251001_32K Epoch AI evaluation · epoch-run Run: 2025-10-22 · frontiermath_tier_4.csv Reported standard error: ±2.08 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| MATH level 5Reasoning | 96.36%claude-haiku-4-5-20251001_32K Epoch AI evaluation · epoch-run Run: 2025-10-22 · math_level_5.csv Reported standard error: ±0.52 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| MATH level 5Reasoning | 86.91%claude-haiku-4-5-20251001 Epoch AI evaluation · epoch-run Run: 2025-10-16 · math_level_5.csv Reported standard error: ±0.77 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 66.67%claude-haiku-4-5-20251001_32K Epoch AI evaluation · epoch-run Run: 2025-10-22 · otis_mock_aime_2024_2025.csv Reported standard error: ±7.11 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 35.83%claude-haiku-4-5-20251001 Epoch AI evaluation · epoch-run Run: 2025-10-16 · otis_mock_aime_2024_2025.csv Reported standard error: ±6.24 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| SimpleQA VerifiedKnowledge | 12.60%claude-haiku-4-5-20251001_32K Epoch AI evaluation · epoch-run Run: 2026-08-27 · simpleqa_verified.csv Reported standard error: ±1.05 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| SimpleQA VerifiedKnowledge | 13.20%claude-haiku-4-5-20251001 Epoch AI evaluation · epoch-run Run: 2026-08-10 · simpleqa_verified.csv Reported standard error: ±1.07 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| Chess PuzzlesReasoning | 8.00%claude-haiku-4-5-20251001_59K Epoch AI evaluation · epoch-run Run: 2026-10-13 · chess_puzzles.csv Reported standard error: ±2.73 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| Chess PuzzlesReasoning | 5.00%claude-haiku-4-5-20251001_32K Epoch AI evaluation · epoch-run Run: 2026-10-13 · chess_puzzles.csv Reported standard error: ±2.19 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| ARC-AGIReasoning | 47.67%claude-haiku-4-5-20251001_32K External result; evaluator not specified · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 37.33%claude-haiku-4-5-20251001_16K External result; evaluator not specified · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 25.50%claude-haiku-4-5-20251001_8K External result; evaluator not specified · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 16.83%claude-haiku-4-5-20251001_1K External result; evaluator not specified · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 14.33%claude-haiku-4-5-20251001 External result; evaluator not specified · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| BalrogAgents | 31.20%claude-haiku-4-5-20251001 Balrog Leaderboard · external Run: Date not supplied · balrog_external.csv https://balrogai.com/ Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| BalrogAgents | 31.20%claude-haiku-4-5-20251001_1K https://balrogai.com/ · external Run: Date not supplied · balrog_external.csv Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| DeepResearch BenchAgents | 45.50%claude-haiku-4-5-20251001_low https://evals.futuresearch.ai/#drb · external Run: Date not supplied · deepresearchbench_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 35.51%claude-haiku-4-5-20251001_unknown https://www.tbench.ai/leaderboard/terminal-bench/2.0 · external Run: 2025-10-15 · terminalbench_external.csv Reported standard error: ±2.89 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / Goose | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 29.83%claude-haiku-4-5-20251001_unknown https://www.tbench.ai/leaderboard/terminal-bench/2.0 · external Run: 2025-10-15 · terminalbench_external.csv Reported standard error: ±2.51 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / Mini-SWE-Agent | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 29.80%claude-haiku-4-5-20251001 Terminal-Bench v2 Leaderboard · external Run: 2025-11-03 · terminalbench_external.csv Reported standard error: ±2.50 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Mini-SWE-Agent | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 28.31%claude-haiku-4-5-20251001_unknown https://www.tbench.ai/leaderboard/terminal-bench/2.0 · external Run: 2025-10-15 · terminalbench_external.csv Reported standard error: ±2.88 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / Terminus 2 | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 28.30%claude-haiku-4-5-20251001 Terminal-Bench v2 Leaderboard · external Run: 2025-10-31 · terminalbench_external.csv Reported standard error: ±2.90 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Terminus 2 | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 27.53%claude-haiku-4-5-20251001_unknown https://www.tbench.ai/leaderboard/terminal-bench/2.0 · external Run: 2025-10-15 · terminalbench_external.csv Reported standard error: ±2.78 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / Claude Code | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 27.50%claude-haiku-4-5-20251001 Terminal-Bench v2 Leaderboard · external Run: 2025-11-04 · terminalbench_external.csv Reported standard error: ±2.80 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Claude Code | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 13.93%claude-haiku-4-5-20251001_unknown https://www.tbench.ai/leaderboard/terminal-bench/2.0 · external Run: 2025-10-15 · terminalbench_external.csv Reported standard error: ±2.73 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / OpenHands | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 13.90%claude-haiku-4-5-20251001 Terminal-Bench v2 Leaderboard · external Run: 2025-11-02 · terminalbench_external.csv Reported standard error: ±2.70 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / OpenHands | External · via Epoch ↗ |
|---|
| WeirdMLCoding | 45.40%claude-haiku-4-5-20251001 https://htihle.github.io/weirdml.html · external Run: Date not supplied · weirdml_external.csv Reported standard error: ±0.01 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| WeirdMLCoding | 44.15%claude-haiku-4-5-20251001_16K https://htihle.github.io/weirdml.html · external Run: Date not supplied · weirdml_external.csv Reported standard error: ±0.01 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 4.03%claude-haiku-4-5-20251001_32K External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 2.78%claude-haiku-4-5-20251001_16K External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 1.67%claude-haiku-4-5-20251001_8K External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 1.25%claude-haiku-4-5-20251001 External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 1.25%claude-haiku-4-5-20251001_1K External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| CritPtOther | 0.00%claude-haiku-4-5-20251001_unknown External result; evaluator not specified · external Run: Date not supplied · critpt_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| ExploitBenchCoding | 13.70%claude-haiku-4-5-20251001_unknown External result; evaluator not specified · external Run: Date not supplied · exploitbench_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| ExploitBenchCoding | 13.40%claude-haiku-4-5-20251001_unknown External result; evaluator not specified · external Run: Date not supplied · exploitbench_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| LMCAReasoning | 30.94%claude-haiku-4-5-20251001_unknown https://conceptualreasoning.ai/lmca · external Run: Date not supplied · lmca_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| DTBenchReasoning | 73.60%claude-haiku-4-5-20251001_unknown https://conceptualreasoning.ai/dtbench · external Run: Date not supplied · dtbench_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|