| GPQA diamondKnowledge | 76.77%claude-opus-4-1-20250805_27K Epoch AI evaluation · epoch-run Run: 2025-08-05 · gpqa_diamond.csv Reported standard error: ±3.01 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| GPQA diamondKnowledge | 77.27%claude-opus-4-1-20250805_16K Epoch AI evaluation · epoch-run Run: 2025-08-05 · gpqa_diamond.csv Reported standard error: ±2.99 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| GPQA diamondKnowledge | 73.23%claude-opus-4-1-20250805 Epoch AI evaluation · epoch-run Run: 2025-08-05 · gpqa_diamond.csv Reported standard error: ±3.15 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-2025-02-28-PrivateReasoning | 7.24%claude-opus-4-1-20250805_27K Epoch AI evaluation · epoch-run Run: 2025-08-05 · frontiermath.csv Reported standard error: ±1.52 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-2025-02-28-PrivateReasoning | 5.86%claude-opus-4-1-20250805 Epoch AI evaluation · epoch-run Run: 2025-08-05 · frontiermath.csv Reported standard error: ±1.38 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tier-4-2025-07-01-PrivateReasoning | 4.17%claude-opus-4-1-20250805_27K Epoch AI evaluation · epoch-run Run: 2025-08-05 · frontiermath_tier_4.csv Reported standard error: ±2.91 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tiers-1-3-v2-PrivateReasoning | 12.63%claude-opus-4-1-20250805_32K Epoch AI evaluation · epoch-run Run: 2026-06-11 · frontiermath_tiers_1_3_v2.csv Reported standard error: ±1.97 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tier-4-v2-PrivateReasoning | 2.44%claude-opus-4-1-20250805_32K Epoch AI evaluation · epoch-run Run: 2026-06-11 · frontiermath_tier_4_v2.csv Reported standard error: ±2.44 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 68.89%claude-opus-4-1-20250805_27K Epoch AI evaluation · epoch-run Run: 2025-08-05 · otis_mock_aime_2024_2025.csv Reported standard error: ±6.98 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 64.44%claude-opus-4-1-20250805_16K Epoch AI evaluation · epoch-run Run: 2025-08-05 · otis_mock_aime_2024_2025.csv Reported standard error: ±7.22 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 40.00%claude-opus-4-1-20250805 Epoch AI evaluation · epoch-run Run: 2025-08-05 · otis_mock_aime_2024_2025.csv Reported standard error: ±7.39 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| SWE-Bench verifiedCoding | 73.35%claude-opus-4-1-20250805 Epoch AI evaluation · epoch-run Run: 2026-02-11 · swe_bench_verified.csv Reported standard error: ±2.01 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| EBR-benchOther | 7.94%claude-opus-4-1-20250805 Epoch AI evaluation · epoch-run Run: 2026-06-25 · ebr_bench.csv Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| Mystery Game PuzzlesReasoning | 21.00%claude-opus-4-1-20250805_24K Epoch AI evaluation · epoch-run Run: 2026-07-25 · mystery_game_puzzles.csv Reported standard error: ±4.09 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| CybenchCoding | 42.00%claude-opus-4-1-20250805 Cybench leaderboard · external Run: Date not supplied · cybench_external.csv Thinking level unknown. "Results for Claude 4.5 Sonnet, Claude 4.1 Opus, Claude 4 Opus, and Claude 4 Sonnet are from the Claude 4.5 Sonnet System Card on a subset of 37 problems. Percentages are estimates based on probability of success on 1 trial." Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| DeepResearch BenchAgents | 48.30%claude-opus-4-1-20250805 https://evals.futuresearch.ai/#drb · external Run: Date not supplied · deepresearchbench_external.csv Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| SimpleBenchReasoning | 60.00%claude-opus-4-1-20250805 SimpleBench Leaderboard · external Run: Date not supplied · simplebench_external.csv Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| SimpleBenchReasoning | 60.00%claude-opus-4-1-20250805_unknown SimpleBench Leaderboard · external Run: Date not supplied · simplebench_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 38.00%claude-opus-4-1-20250805 Terminal-Bench v2 Leaderboard · external Run: 2025-10-31 · terminalbench_external.csv Reported standard error: ±2.60 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Terminus 2 | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 37.98%claude-opus-4-1-20250805_unknown https://www.tbench.ai/leaderboard/terminal-bench/2.0 · external Run: 2025-08-05 · terminalbench_external.csv Reported standard error: ±2.62 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / Terminus 2 | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 36.90%claude-opus-4-1-20250805 Terminal-Bench v2 Leaderboard · external Run: 2025-11-02 · terminalbench_external.csv Reported standard error: ±2.70 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / OpenHands | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 36.85%claude-opus-4-1-20250805_unknown https://www.tbench.ai/leaderboard/terminal-bench/2.0 · external Run: 2025-08-05 · terminalbench_external.csv Reported standard error: ±2.70 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / OpenHands | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 35.10%claude-opus-4-1-20250805 Terminal-Bench v2 Leaderboard · external Run: 2025-11-03 · terminalbench_external.csv Reported standard error: ±2.50 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Mini-SWE-Agent | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 35.06%claude-opus-4-1-20250805_unknown https://www.tbench.ai/leaderboard/terminal-bench/2.0 · external Run: 2025-08-05 · terminalbench_external.csv Reported standard error: ±2.51 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / Mini-SWE-Agent | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 34.83%claude-opus-4-1-20250805_unknown https://www.tbench.ai/leaderboard/terminal-bench/2.0 · external Run: 2025-08-05 · terminalbench_external.csv Reported standard error: ±2.90 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / Claude Code | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 34.80%claude-opus-4-1-20250805 Terminal-Bench v2 Leaderboard · external Run: 2025-11-04 · terminalbench_external.csv Reported standard error: ±2.90 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Claude Code | External · via Epoch ↗ |
|---|
| VPCTOther | 35.00%claude-opus-4-1-20250805 VPCT leaderboard · external Run: Date not supplied · vpct_external.csv Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| VPCTOther | 33.00%claude-opus-4-1-20250805_16K VPCT leaderboard · external Run: Date not supplied · vpct_external.csv Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| WeirdMLCoding | 45.86%claude-opus-4-1-20250805_16K https://htihle.github.io/weirdml.html · external Run: Date not supplied · weirdml_external.csv Reported standard error: ±0.01 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| HLEKnowledge | 11.52%claude-opus-4-1-20250805_unknown External result; evaluator not specified · external Run: Date not supplied · hle_external.csv Reported standard error: ±1.25 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| HLEKnowledge | 7.92%claude-opus-4-1-20250805_unknown External result; evaluator not specified · external Run: Date not supplied · hle_external.csv Reported standard error: ±1.06 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| GDPvalAgents | 43.60%claude-opus-4-1-20250805 External result; evaluator not specified · external Run: Date not supplied · gdpval_external.csv Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| METR Time HorizonsOther | 66.81%claude-opus-4-1-20250805_16K METR - Measuring AI Ability to Complete Long Tasks · external Run: Date not supplied · metr_time_horizons_external.csv Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| METR Time HorizonsOther | 61.57%claude-opus-4-1-20250805 External result; evaluator not specified · external Run: Date not supplied · metr_time_horizons_external.csv Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| LMCAReasoning | 37.08%claude-opus-4-1-20250805_unknown https://conceptualreasoning.ai/lmca · external Run: Date not supplied · lmca_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| DTBenchReasoning | 80.00%claude-opus-4-1-20250805_unknown https://conceptualreasoning.ai/dtbench · external Run: Date not supplied · dtbench_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| EnigmaEvalOther | 7.18%claude-opus-4-1-20250805_unknown https://labs.scale.com/leaderboard/enigma_eval · external Run: Date not supplied · enigma_eval_external.csv Reported standard error: ±1.47 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|