| GPQA diamondKnowledge | 80.30%claude-sonnet-5_max Epoch AI evaluation · epoch-run Run: 2026-08-06 · gpqa_diamond.csv Reported standard error: ±2.83 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| GPQA diamondKnowledge | 90.53%claude-sonnet-5_xhigh Epoch AI evaluation · epoch-run Run: 2026-07-01 · gpqa_diamond.csv Reported standard error: ±1.78 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | xhigh / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tiers-1-3-v2-PrivateReasoning | 65.61%claude-sonnet-5_max Epoch AI evaluation · epoch-run Run: 2026-06-30 · frontiermath_tiers_1_3_v2.csv Reported standard error: ±2.82 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tier-4-v2-PrivateReasoning | 29.27%claude-sonnet-5_max Epoch AI evaluation · epoch-run Run: 2026-06-30 · frontiermath_tier_4_v2.csv Reported standard error: ±7.19 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 80.00%claude-sonnet-5_max Epoch AI evaluation · epoch-run Run: 2026-08-06 · otis_mock_aime_2024_2025.csv Reported standard error: ±6.03 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 94.72%claude-sonnet-5_xhigh Epoch AI evaluation · epoch-run Run: 2026-07-01 · otis_mock_aime_2024_2025.csv Reported standard error: ±2.26 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | xhigh / Epoch Inspect | Epoch AI run ↗ |
|---|
| SimpleQA VerifiedKnowledge | 32.90%claude-sonnet-5_xhigh Epoch AI evaluation · epoch-run Run: 2026-08-27 · simpleqa_verified.csv Reported standard error: ±1.49 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | xhigh / Epoch Inspect | Epoch AI run ↗ |
|---|
| SimpleQA VerifiedKnowledge | 33.70%claude-sonnet-5_max Epoch AI evaluation · epoch-run Run: 2026-08-27 · simpleqa_verified.csv Reported standard error: ±1.50 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| Chess PuzzlesReasoning | 45.00%claude-sonnet-5_max Epoch AI evaluation · epoch-run Run: 2026-10-13 · chess_puzzles.csv Reported standard error: ±5.00 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| Chess PuzzlesReasoning | 34.00%claude-sonnet-5_xhigh Epoch AI evaluation · epoch-run Run: 2026-10-13 · chess_puzzles.csv Reported standard error: ±4.76 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | xhigh / Epoch Inspect | Epoch AI run ↗ |
|---|
| Mystery Game PuzzlesReasoning | 16.00%claude-sonnet-5 Epoch AI evaluation · epoch-run Run: 2026-08-06 · mystery_game_puzzles.csv Reported standard error: ±3.68 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| Mystery Game PuzzlesReasoning | 35.00%claude-sonnet-5_max Epoch AI evaluation · epoch-run Run: 2026-07-28 · mystery_game_puzzles.csv Reported standard error: ±4.79 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| GSO-BenchCoding | 37.25%claude-sonnet-5_unknown https://gso-bench.github.io/index.html · external Run: Date not supplied · gso_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| SimpleBenchReasoning | 60.60%claude-sonnet-5_unknown SimpleBench Leaderboard · external Run: Date not supplied · simplebench_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| WeirdMLCoding | 68.78%claude-sonnet-5_high https://htihle.github.io/weirdml.html · external Run: Date not supplied · weirdml_external.csv Reported standard error: ±0.02 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| APEX-AgentsAgents | 54.50%claude-sonnet-5_unknown External result; evaluator not specified · external Run: Date not supplied · apex_agents_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| CursorBenchOther | 34.10%claude-sonnet-5_max https://cursor.com/cursorbench · external Run: Date not supplied · cursorbench_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| CursorBenchOther | 32.00%claude-sonnet-5_xhigh https://cursor.com/cursorbench · external Run: Date not supplied · cursorbench_external.csv Inspect source ↗CC BY 4.0 | xhigh / Not reported | External · via Epoch ↗ |
|---|
| CursorBenchOther | 30.80%claude-sonnet-5_high https://cursor.com/cursorbench · external Run: Date not supplied · cursorbench_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| CursorBenchOther | 28.00%claude-sonnet-5_medium https://cursor.com/cursorbench · external Run: Date not supplied · cursorbench_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| CursorBenchOther | 24.10%claude-sonnet-5_low https://cursor.com/cursorbench · external Run: Date not supplied · cursorbench_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| GBAEvalOther | 65.26%claude-sonnet-5_unknown https://gbaeval.com/model/claude-sonnet-5 · external Run: Date not supplied · gbaeval_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| CritPtOther | 16.86%claude-sonnet-5_max External result; evaluator not specified · external Run: Date not supplied · critpt_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| CritPtOther | 15.43%claude-sonnet-5_xhigh External result; evaluator not specified · external Run: Date not supplied · critpt_external.csv Inspect source ↗CC BY 4.0 | xhigh / Not reported | External · via Epoch ↗ |
|---|
| CritPtOther | 8.57%claude-sonnet-5_medium External result; evaluator not specified · external Run: Date not supplied · critpt_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| CritPtOther | 4.57%claude-sonnet-5_low External result; evaluator not specified · external Run: Date not supplied · critpt_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| CritPtOther | 1.14%claude-sonnet-5_high External result; evaluator not specified · external Run: Date not supplied · critpt_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| Surface Evolver BenchOther | 60.00%claude-sonnet-5_medium https://yhenon.github.io/surface-evolver-llm-eval/ · external Run: Date not supplied · surface_evolver_bench_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| DeepSWECoding | 53.85%claude-sonnet-5_max https://deepswe.datacurve.ai/ · external Run: Date not supplied · deepswe_external.csv Inspect source ↗CC BY 4.0 | max / mini-swe-agent | External · via Epoch ↗ |
|---|
| DeepSWECoding | 49.67%claude-sonnet-5_xhigh https://deepswe.datacurve.ai/ · external Run: Date not supplied · deepswe_external.csv Inspect source ↗CC BY 4.0 | xhigh / mini-swe-agent | External · via Epoch ↗ |
|---|
| DeepSWECoding | 48.23%claude-sonnet-5_high https://deepswe.datacurve.ai/ · external Run: Date not supplied · deepswe_external.csv Inspect source ↗CC BY 4.0 | high / mini-swe-agent | External · via Epoch ↗ |
|---|
| DeepSWECoding | 39.78%claude-sonnet-5_medium https://deepswe.datacurve.ai/ · external Run: Date not supplied · deepswe_external.csv Inspect source ↗CC BY 4.0 | medium / mini-swe-agent | External · via Epoch ↗ |
|---|
| DeepSWECoding | 30.51%claude-sonnet-5_low https://deepswe.datacurve.ai/ · external Run: Date not supplied · deepswe_external.csv Inspect source ↗CC BY 4.0 | low / mini-swe-agent | External · via Epoch ↗ |
|---|
| ProofBenchReasoning | 77.00%claude-sonnet-5_max https://www.vals.ai/benchmarks/proof_bench · external Run: Date not supplied · proofbench_external.csv Reported standard error: ±4.23 pp. This is not a 90% interval. ProofBench v1.1 re-grade (vals.ai, 2026-08-14): corrected Lean formalizations + hardened grader (rejects sorry/admit shortcuts, larger elaboration budgets). Not comparable to v1.0-era values. Updated 2026-08-18 after multi-agent verification. Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| FrontierCodeCoding | 42.73%claude-sonnet-5_unknown https://cognition.com/frontiercode · external Run: Date not supplied · frontiercode_external.csv Inspect source ↗CC BY 4.0 | unknown / claude-code | External · via Epoch ↗ |
|---|
| LMCAReasoning | 49.30%claude-sonnet-5_max https://conceptualreasoning.ai/lmca · external Run: Date not supplied · lmca_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| LMCAReasoning | 48.81%claude-sonnet-5_xhigh https://conceptualreasoning.ai/lmca · external Run: Date not supplied · lmca_external.csv Inspect source ↗CC BY 4.0 | xhigh / Not reported | External · via Epoch ↗ |
|---|
| LMCAReasoning | 50.02%claude-sonnet-5_high https://conceptualreasoning.ai/lmca · external Run: Date not supplied · lmca_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| LMCAReasoning | 49.71%claude-sonnet-5_medium https://conceptualreasoning.ai/lmca · external Run: Date not supplied · lmca_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| LMCAReasoning | 49.65%claude-sonnet-5_low https://conceptualreasoning.ai/lmca · external Run: Date not supplied · lmca_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| DTBenchReasoning | 92.48%claude-sonnet-5_max https://conceptualreasoning.ai/dtbench · external Run: Date not supplied · dtbench_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| DTBenchReasoning | 89.51%claude-sonnet-5_xhigh https://conceptualreasoning.ai/dtbench · external Run: Date not supplied · dtbench_external.csv Inspect source ↗CC BY 4.0 | xhigh / Not reported | External · via Epoch ↗ |
|---|
| DTBenchReasoning | 84.53%claude-sonnet-5_high https://conceptualreasoning.ai/dtbench · external Run: Date not supplied · dtbench_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| DTBenchReasoning | 79.20%claude-sonnet-5_medium https://conceptualreasoning.ai/dtbench · external Run: Date not supplied · dtbench_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| DTBenchReasoning | 73.60%claude-sonnet-5_low https://conceptualreasoning.ai/dtbench · external Run: Date not supplied · dtbench_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| Terminal-Bench 4.0Agents | 12.42%Claude Sonnet 5 · Claude Code · max Terminal-Bench public leaderboard · benchmark-publisher Run: 2026-06-30 · 4-0-0/8180b9e4-4990-43d0-b906-cd8b43adaaa2 Published model + agent result; agents differ across models. Not a controlled model-only evaluation. Reported trials: 330. Source 95% accuracy interval half-width: 3.06 pp; this is not a DC Power interval. Inspect source ↗Attributed public leaderboard score facts · Terminal-Bench | max / Terminal-Bench 4.0 · Claude Code | Terminal-Bench ↗ |
|---|