| GPQA diamondKnowledge | 78.79%claude-sonnet-4-5-20250929_16K Epoch AI evaluation · epoch-run Run: 2025-10-28 · gpqa_diamond.csv Reported standard error: ±2.91 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| GPQA diamondKnowledge | 82.32%claude-sonnet-4-5-20250929_59K Epoch AI evaluation · epoch-run Run: 2025-10-28 · gpqa_diamond.csv Reported standard error: ±2.72 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| GPQA diamondKnowledge | 81.73%claude-sonnet-4-5-20250929_32K Epoch AI evaluation · epoch-run Run: 2025-10-21 · gpqa_diamond.csv Reported standard error: ±2.76 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| GPQA diamondKnowledge | 73.74%claude-sonnet-4-5-20250929 Epoch AI evaluation · epoch-run Run: 2025-09-29 · gpqa_diamond.csv Reported standard error: ±3.14 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-2025-02-28-PrivateReasoning | 9.31%claude-sonnet-4-5-20250929 Epoch AI evaluation · epoch-run Run: 2025-11-16 · frontiermath.csv Reported standard error: ±1.71 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-2025-02-28-PrivateReasoning | 15.22%claude-sonnet-4-5-20250929_32K Epoch AI evaluation · epoch-run Run: 2025-11-16 · frontiermath.csv Reported standard error: ±2.12 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-2025-02-28-PrivateReasoning | 13.49%claude-sonnet-4-5-20250929_59K Epoch AI evaluation · epoch-run Run: 2025-11-13 · frontiermath.csv Reported standard error: ±2.01 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tier-4-2025-07-01-PrivateReasoning | 4.17%claude-sonnet-4-5-20250929_32K Epoch AI evaluation · epoch-run Run: 2025-10-22 · frontiermath_tier_4.csv Reported standard error: ±2.91 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tier-4-2025-07-01-PrivateReasoning | 2.08%claude-sonnet-4-5-20250929 Epoch AI evaluation · epoch-run Run: 2025-09-29 · frontiermath_tier_4.csv Reported standard error: ±2.08 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tiers-1-3-v2-PrivateReasoning | 23.86%claude-sonnet-4-5-20250929_32K Epoch AI evaluation · epoch-run Run: 2026-06-11 · frontiermath_tiers_1_3_v2.csv Reported standard error: ±2.53 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tier-4-v2-PrivateReasoning | 2.44%claude-sonnet-4-5-20250929_32K Epoch AI evaluation · epoch-run Run: 2026-06-11 · frontiermath_tier_4_v2.csv Reported standard error: ±2.44 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| MATH level 5Reasoning | 97.73%claude-sonnet-4-5-20250929_32K Epoch AI evaluation · epoch-run Run: 2025-10-21 · math_level_5.csv Reported standard error: ±0.41 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 77.78%claude-sonnet-4-5-20250929_59K Epoch AI evaluation · epoch-run Run: 2025-10-28 · otis_mock_aime_2024_2025.csv Reported standard error: ±6.27 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 71.11%claude-sonnet-4-5-20250929_16K Epoch AI evaluation · epoch-run Run: 2025-10-28 · otis_mock_aime_2024_2025.csv Reported standard error: ±6.83 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 77.78%claude-sonnet-4-5-20250929_32K Epoch AI evaluation · epoch-run Run: 2025-10-21 · otis_mock_aime_2024_2025.csv Reported standard error: ±6.27 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 35.56%claude-sonnet-4-5-20250929 Epoch AI evaluation · epoch-run Run: 2025-09-29 · otis_mock_aime_2024_2025.csv Reported standard error: ±7.22 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| SWE-Bench verifiedCoding | 71.28%claude-sonnet-4-5-20250929 Epoch AI evaluation · epoch-run Run: 2026-02-05 · swe_bench_verified.csv Reported standard error: ±2.06 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| SimpleQA VerifiedKnowledge | 30.70%claude-sonnet-4-5-20250929_59K Epoch AI evaluation · epoch-run Run: 2026-08-27 · simpleqa_verified.csv Reported standard error: ±1.46 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| SimpleQA VerifiedKnowledge | 23.70%claude-sonnet-4-5-20250929 Epoch AI evaluation · epoch-run Run: 2026-08-10 · simpleqa_verified.csv Reported standard error: ±1.35 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| Chess PuzzlesReasoning | 10.00%claude-sonnet-4-5-20250929_59K Epoch AI evaluation · epoch-run Run: 2026-10-13 · chess_puzzles.csv Reported standard error: ±3.02 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| Chess PuzzlesReasoning | 10.00%claude-sonnet-4-5-20250929_32K Epoch AI evaluation · epoch-run Run: 2026-10-13 · chess_puzzles.csv Reported standard error: ±3.02 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| Chess PuzzlesReasoning | 6.00%claude-sonnet-4-5-20250929 Epoch AI evaluation · epoch-run Run: 2026-10-13 · chess_puzzles.csv Reported standard error: ±2.39 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| EBR-benchOther | 2.38%claude-sonnet-4-5-20250929 Epoch AI evaluation · epoch-run Run: 2026-06-25 · ebr_bench.csv Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| Mystery Game PuzzlesReasoning | 17.00%claude-sonnet-4-5-20250929_48K Epoch AI evaluation · epoch-run Run: 2026-07-25 · mystery_game_puzzles.csv Reported standard error: ±3.78 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| ARC-AGIReasoning | 63.67%claude-sonnet-4-5-20250929_32K External result; evaluator not specified · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 48.33%claude-sonnet-4-5-20250929_16K External result; evaluator not specified · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 46.50%claude-sonnet-4-5-20250929_8K External result; evaluator not specified · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 31.00%claude-sonnet-4-5-20250929_1K External result; evaluator not specified · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 25.50%claude-sonnet-4-5-20250929 External result; evaluator not specified · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| CybenchCoding | 60.00%claude-sonnet-4-5-20250929_unknown Opus 4.5 System Card · external Run: Date not supplied · cybench_external.csv Results from Opus 4.5 system card, also reported on the official Cybench leaderboard Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| CybenchCoding | 55.00%claude-sonnet-4-5-20250929 Cybench leaderboard · external Run: Date not supplied · cybench_external.csv Thinking level unknown. "Results for Claude 4.5 Sonnet, Claude 4.1 Opus, Claude 4 Opus, and Claude 4 Sonnet are from the Claude 4.5 Sonnet System Card on a subset of 37 problems. Percentages are estimates based on probability of success on 1 trial." Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| DeepResearch BenchAgents | 52.60%claude-sonnet-4-5-20250929_2K DeepResearchBench Leaderboard · external Run: Date not supplied · deepresearchbench_external.csv Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| DeepResearch BenchAgents | 47.50%claude-sonnet-4-5-20250929_low https://evals.futuresearch.ai/#drb · external Run: Date not supplied · deepresearchbench_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| GSO-BenchCoding | 14.71%claude-sonnet-4-5-20250929_unknown https://gso-bench.github.io/index.html · external Run: Date not supplied · gso_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| GSO-BenchCoding | 14.70%claude-sonnet-4-5-20250929 GSO Leaderboard · external Run: Date not supplied · gso_external.csv Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| OSWorldAgents | 62.90%claude-sonnet-4-5-20250929 OS World Website · external Run: Date not supplied · os_world_external.csv Inspect source ↗CC BY 4.0 | unspecified / claude-sonnet-4-5-20250929 (100 steps) | External · via Epoch ↗ |
|---|
| OSWorldAgents | 58.10%claude-sonnet-4-5-20250929 OS World Website · external Run: Date not supplied · os_world_external.csv Inspect source ↗CC BY 4.0 | unspecified / claude-sonnet-4-5-20250929 (50 steps) | External · via Epoch ↗ |
|---|
| OSWorldAgents | 42.90%claude-sonnet-4-5-20250929 OS World Website · external Run: Date not supplied · os_world_external.csv Inspect source ↗CC BY 4.0 | unspecified / claude-sonnet-4-5-20250929 (15 steps) | External · via Epoch ↗ |
|---|
| SimpleBenchReasoning | 54.30%claude-sonnet-4-5-20250929_12K SimpleBench Leaderboard · external Run: Date not supplied · simplebench_external.csv Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| SimpleBenchReasoning | 54.30%claude-sonnet-4-5-20250929_unknown SimpleBench Leaderboard · external Run: Date not supplied · simplebench_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 46.52%claude-sonnet-4-5-20250929_unknown https://www.tbench.ai/leaderboard/terminal-bench/2.0 · external Run: 2025-09-29 · terminalbench_external.csv Reported standard error: ±2.35 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / CAMEL-AI | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 43.15%claude-sonnet-4-5-20250929_unknown https://www.tbench.ai/leaderboard/terminal-bench/2.0 · external Run: 2025-09-29 · terminalbench_external.csv Reported standard error: ±2.59 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / Goose | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 42.81%claude-sonnet-4-5-20250929_unknown https://www.tbench.ai/leaderboard/terminal-bench/2.0 · external Run: 2025-09-29 · terminalbench_external.csv Reported standard error: ±2.79 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / Terminus 2 | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 42.80%claude-sonnet-4-5-20250929 Terminal-Bench v2 Leaderboard · external Run: 2025-10-31 · terminalbench_external.csv Reported standard error: ±2.80 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Terminus 2 | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 42.70%claude-sonnet-4-5-20250929_unknown External result; evaluator not specified · external Run: 2026-01-04 · terminalbench_external.csv Inspect source ↗CC BY 4.0 | unknown / MAYA | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 42.70%claude-sonnet-4-5-20250929_unknown https://www.tbench.ai/leaderboard/terminal-bench/2.0 · external Run: 2025-09-29 · terminalbench_external.csv Inspect source ↗CC BY 4.0 | unknown / MAYA-V2 | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 42.60%claude-sonnet-4-5-20250929 Terminal-Bench v2 Leaderboard · external Run: 2025-11-02 · terminalbench_external.csv Reported standard error: ±2.80 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / OpenHands | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 42.58%claude-sonnet-4-5-20250929_unknown https://www.tbench.ai/leaderboard/terminal-bench/2.0 · external Run: 2025-09-29 · terminalbench_external.csv Reported standard error: ±2.77 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / OpenHands | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 42.53%claude-sonnet-4-5-20250929_unknown https://www.tbench.ai/leaderboard/terminal-bench/2.0 · external Run: 2025-09-29 · terminalbench_external.csv Reported standard error: ±2.81 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / Mini-SWE-Agent | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 42.50%claude-sonnet-4-5-20250929 Terminal-Bench v2 Leaderboard · external Run: 2025-11-03 · terminalbench_external.csv Reported standard error: ±2.80 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Mini-SWE-Agent | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 40.10%claude-sonnet-4-5-20250929 Terminal-Bench v2 Leaderboard · external Run: 2025-11-04 · terminalbench_external.csv Reported standard error: ±2.90 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Claude Code | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 40.06%claude-sonnet-4-5-20250929_unknown https://www.tbench.ai/leaderboard/terminal-bench/2.0 · external Run: 2025-09-29 · terminalbench_external.csv Reported standard error: ±2.92 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / Claude Code | External · via Epoch ↗ |
|---|
| VPCTOther | 39.80%claude-sonnet-4-5-20250929_32K VPCT leaderboard · external Run: Date not supplied · vpct_external.csv Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| VPCTOther | 38.00%claude-sonnet-4-5-20250929 VPCT leaderboard · external Run: Date not supplied · vpct_external.csv Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| WeirdMLCoding | 47.71%claude-sonnet-4-5-20250929_16K https://htihle.github.io/weirdml.html · external Run: Date not supplied · weirdml_external.csv Reported standard error: ±0.01 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| WeirdMLCoding | 46.70%claude-sonnet-4-5-20250929 https://htihle.github.io/weirdml.html · external Run: Date not supplied · weirdml_external.csv Reported standard error: ±0.01 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 13.61%claude-sonnet-4-5-20250929_32K External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 6.94%claude-sonnet-4-5-20250929_16K External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 6.94%claude-sonnet-4-5-20250929_8K External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 5.83%claude-sonnet-4-5-20250929_1K External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 3.75%claude-sonnet-4-5-20250929 External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| HLEKnowledge | 13.72%claude-sonnet-4-5-20250929_unknown External result; evaluator not specified · external Run: Date not supplied · hle_external.csv Reported standard error: ±1.35 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| HLEKnowledge | 7.52%claude-sonnet-4-5-20250929_unknown External result; evaluator not specified · external Run: Date not supplied · hle_external.csv Reported standard error: ±1.03 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| CritPtOther | 1.14%claude-sonnet-4-5-20250929_unknown External result; evaluator not specified · external Run: Date not supplied · critpt_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| Remote Labor IndexAgents | 2.08%claude-sonnet-4-5-20250929_unknown External result; evaluator not specified · external Run: Date not supplied · rli_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| GDPvalAgents | 42.50%claude-sonnet-4-5-20250929 External result; evaluator not specified · external Run: Date not supplied · gdpval_external.csv Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| METR Time HorizonsOther | 67.38%claude-sonnet-4-5-20250929_16K METR - Measuring AI Ability to Complete Long Tasks · external Run: Date not supplied · metr_time_horizons_external.csv Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| ProofBenchReasoning | 19.00%claude-sonnet-4-5-20250929_unknown https://www.vals.ai/benchmarks/proof_bench · external Run: Date not supplied · proofbench_external.csv Reported standard error: ±3.92 pp. This is not a 90% interval. ProofBench v1.0-era value; model absent from the v1.1 board (vals.ai re-grade 2026-08-14, methodology changed) and not re-run. Not comparable to v1.1 rows. Annotated 2026-08-18. Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| LMCAReasoning | 38.76%claude-sonnet-4-5-20250929_unknown https://conceptualreasoning.ai/lmca · external Run: Date not supplied · lmca_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| DTBenchReasoning | 83.20%claude-sonnet-4-5-20250929_unknown https://conceptualreasoning.ai/dtbench · external Run: Date not supplied · dtbench_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| EnigmaEvalOther | 6.00%claude-sonnet-4-5-20250929_unknown https://labs.scale.com/leaderboard/enigma_eval · external Run: Date not supplied · enigma_eval_external.csv Reported standard error: ±1.35 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|