| GPQA diamondKnowledge | 85.35%claude-opus-4-8_none Epoch AI evaluation · epoch-run Run: 2026-08-06 · gpqa_diamond.csv Reported standard error: ±2.52 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | none / Epoch Inspect | Epoch AI run ↗ |
|---|
| GPQA diamondKnowledge | 88.38%claude-opus-4-8_low Epoch AI evaluation · epoch-run Run: 2026-08-06 · gpqa_diamond.csv Reported standard error: ±2.28 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | low / Epoch Inspect | Epoch AI run ↗ |
|---|
| GPQA diamondKnowledge | 91.04%claude-opus-4-8_max Epoch AI evaluation · epoch-run Run: 2026-06-07 · gpqa_diamond.csv Reported standard error: ±1.92 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-2025-02-28-PrivateReasoning | 47.24%claude-opus-4-8_max Epoch AI evaluation · epoch-run Run: 2026-06-08 · frontiermath.csv Reported standard error: ±2.94 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tier-4-2025-07-01-PrivateReasoning | 31.25%claude-opus-4-8_max Epoch AI evaluation · epoch-run Run: 2026-06-08 · frontiermath_tier_4.csv Reported standard error: ±6.76 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tiers-1-3-v2-PrivateReasoning | 80.00%claude-opus-4-8_max Epoch AI evaluation · epoch-run Run: 2026-06-10 · frontiermath_tiers_1_3_v2.csv Reported standard error: ±2.37 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tier-4-v2-PrivateReasoning | 56.10%claude-opus-4-8_max Epoch AI evaluation · epoch-run Run: 2026-06-10 · frontiermath_tier_4_v2.csv Reported standard error: ±7.85 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 84.44%claude-opus-4-8_none Epoch AI evaluation · epoch-run Run: 2026-08-06 · otis_mock_aime_2024_2025.csv Reported standard error: ±5.46 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | none / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 97.78%claude-opus-4-8_low Epoch AI evaluation · epoch-run Run: 2026-08-06 · otis_mock_aime_2024_2025.csv Reported standard error: ±2.22 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | low / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 98.33%claude-opus-4-8_max Epoch AI evaluation · epoch-run Run: 2026-06-07 · otis_mock_aime_2024_2025.csv Reported standard error: ±1.41 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| SimpleQA VerifiedKnowledge | 53.00%claude-opus-4-8_max Epoch AI evaluation · epoch-run Run: 2026-08-27 · simpleqa_verified.csv Reported standard error: ±1.58 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| Chess PuzzlesReasoning | 52.00%claude-opus-4-8_max Epoch AI evaluation · epoch-run Run: 2026-10-13 · chess_puzzles.csv Reported standard error: ±5.02 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| Chess PuzzlesReasoning | 29.00%claude-opus-4-8_low Epoch AI evaluation · epoch-run Run: 2026-10-13 · chess_puzzles.csv Reported standard error: ±4.56 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | low / Epoch Inspect | Epoch AI run ↗ |
|---|
| Chess PuzzlesReasoning | 19.00%claude-opus-4-8_none Epoch AI evaluation · epoch-run Run: 2026-10-13 · chess_puzzles.csv Reported standard error: ±3.94 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | none / Epoch Inspect | Epoch AI run ↗ |
|---|
| EBR-benchOther | 28.57%claude-opus-4-8_max Epoch AI evaluation · epoch-run Run: 2026-08-07 · ebr_bench.csv Reported standard error: ±1.42 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| Mystery Game PuzzlesReasoning | 31.00%claude-opus-4-8_xhigh Epoch AI evaluation · epoch-run Run: 2026-07-26 · mystery_game_puzzles.csv Reported standard error: ±4.65 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | xhigh / Epoch Inspect | Epoch AI run ↗ |
|---|
| Mystery Game PuzzlesReasoning | 36.00%claude-opus-4-8_max Epoch AI evaluation · epoch-run Run: 2026-07-25 · mystery_game_puzzles.csv Reported standard error: ±4.82 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| ARC-AGIReasoning | 92.50%claude-opus-4-8_max https://arcprize.org/leaderboard · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 92.00%claude-opus-4-8_high https://arcprize.org/leaderboard · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 91.50%claude-opus-4-8_medium https://arcprize.org/leaderboard · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 88.00%claude-opus-4-8_low https://arcprize.org/leaderboard · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| DeepResearch BenchAgents | 50.20%claude-opus-4-8_high https://evals.futuresearch.ai/#drb · external Run: Date not supplied · deepresearchbench_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| DeepResearch BenchAgents | 49.30%claude-opus-4-8_low https://evals.futuresearch.ai/#drb · external Run: Date not supplied · deepresearchbench_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| DeepResearch BenchAgents | 47.40%claude-opus-4-8_medium https://evals.futuresearch.ai/#drb · external Run: Date not supplied · deepresearchbench_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| GSO-BenchCoding | 47.06%claude-opus-4-8_unknown https://gso-bench.github.io/index.html · external Run: Date not supplied · gso_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| SimpleBenchReasoning | 64.80%claude-opus-4-8_unknown https://lmcouncil.ai/benchmarks · external Run: Date not supplied · simplebench_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| WeirdMLCoding | 82.89%claude-opus-4-8_xhigh https://htihle.github.io/weirdml.html · external Run: Date not supplied · weirdml_external.csv Reported standard error: ±0.01 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | xhigh / Not reported | External · via Epoch ↗ |
|---|
| WeirdMLCoding | 76.04%claude-opus-4-8_medium https://htihle.github.io/weirdml.html · external Run: Date not supplied · weirdml_external.csv Reported standard error: ±0.02 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| WeirdMLCoding | 70.45%claude-opus-4-8_none https://htihle.github.io/weirdml.html · external Run: Date not supplied · weirdml_external.csv Reported standard error: ±0.01 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | none / Not reported | External · via Epoch ↗ |
|---|
| APEX-AgentsAgents | 48.90%claude-opus-4-8_max External result; evaluator not specified · external Run: Date not supplied · apex_agents_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 72.08%claude-opus-4-8_high External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 71.67%claude-opus-4-8_medium External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 62.22%claude-opus-4-8_low External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| PostTrainBenchCoding | 33.84%claude-opus-4-8_high External result; evaluator not specified · external Run: Date not supplied · posttrainbench_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| PostTrainBenchCoding | 32.90%claude-opus-4-8_max External result; evaluator not specified · external Run: Date not supplied · posttrainbench_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| GBAEvalOther | 70.90%claude-opus-4-8_unknown https://gbaeval.com/model/claude-opus-4-8 · external Run: Date not supplied · gbaeval_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| CritPtOther | 20.86%claude-opus-4-8_max External result; evaluator not specified · external Run: Date not supplied · critpt_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| Remote Labor IndexAgents | 8.33%claude-opus-4-8_unknown External result; evaluator not specified · external Run: Date not supplied · rli_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| OSWorld 2.0Agents | 20.60%claude-opus-4-8_max https://osworld-v2.xlang.ai/ · external Run: Date not supplied · osworld_2_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| OSWorld 2.0Agents | 18.52%claude-opus-4-8_max https://osworld-v2.xlang.ai/ · external Run: Date not supplied · osworld_2_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| Surface Evolver BenchOther | 87.50%claude-opus-4-8_high https://yhenon.github.io/surface-evolver-llm-eval/ · external Run: Date not supplied · surface_evolver_bench_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| Surface Evolver BenchOther | 68.13%claude-opus-4-8_none https://yhenon.github.io/surface-evolver-llm-eval/ · external Run: Date not supplied · surface_evolver_bench_external.csv Inspect source ↗CC BY 4.0 | none / Not reported | External · via Epoch ↗ |
|---|
| DeepSWECoding | 58.97%claude-opus-4-8_max https://deepswe.datacurve.ai/ · external Run: Date not supplied · deepswe_external.csv Inspect source ↗CC BY 4.0 | max / mini-swe-agent | External · via Epoch ↗ |
|---|
| DeepSWECoding | 54.36%claude-opus-4-8_xhigh https://deepswe.datacurve.ai/ · external Run: Date not supplied · deepswe_external.csv Inspect source ↗CC BY 4.0 | xhigh / mini-swe-agent | External · via Epoch ↗ |
|---|
| DeepSWECoding | 51.77%claude-opus-4-8_high https://deepswe.datacurve.ai/ · external Run: Date not supplied · deepswe_external.csv Inspect source ↗CC BY 4.0 | high / mini-swe-agent | External · via Epoch ↗ |
|---|
| DeepSWECoding | 48.67%claude-opus-4-8_medium https://deepswe.datacurve.ai/ · external Run: Date not supplied · deepswe_external.csv Inspect source ↗CC BY 4.0 | medium / mini-swe-agent | External · via Epoch ↗ |
|---|
| DeepSWECoding | 40.80%claude-opus-4-8_low https://deepswe.datacurve.ai/ · external Run: Date not supplied · deepswe_external.csv Inspect source ↗CC BY 4.0 | low / mini-swe-agent | External · via Epoch ↗ |
|---|
| ProofBenchReasoning | 69.00%claude-opus-4-8_max https://www.vals.ai/benchmarks/proof_bench · external Run: Date not supplied · proofbench_external.csv Reported standard error: ±4.65 pp. This is not a 90% interval. ProofBench v1.0-era value; model absent from the v1.1 board (vals.ai re-grade 2026-08-14, methodology changed) and not re-run. Not comparable to v1.1 rows. Annotated 2026-08-18. Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| FrontierCodeCoding | 46.50%claude-opus-4-8_unknown https://cognition.com/frontiercode · external Run: Date not supplied · frontiercode_external.csv Inspect source ↗CC BY 4.0 | unknown / claude-code | External · via Epoch ↗ |
|---|
| LMCAReasoning | 57.51%claude-opus-4-8_max https://conceptualreasoning.ai/lmca · external Run: Date not supplied · lmca_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| DTBenchReasoning | 94.93%claude-opus-4-8_max https://conceptualreasoning.ai/dtbench · external Run: Date not supplied · dtbench_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| Furniture AssemblyReasoning | 42.50%claude-opus-4-8_max Epoch AI evaluation · epoch-run Run: 2026-09-10 · furniture_assembly.csv Reported standard error: ±6.38 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| GDP.pdfOther | 24.00%claude-opus-4-8_max https://surgehq.ai/benchmarks/gdp-pdf · external Run: Date not supplied · gdp_pdf_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| EnigmaEvalOther | 23.51%claude-opus-4-8_xhigh https://labs.scale.com/leaderboard/enigma_eval · external Run: Date not supplied · enigma_eval_external.csv Reported standard error: ±2.41 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | xhigh / Not reported | External · via Epoch ↗ |
|---|
| Terminal-Bench 4.0Agents | 23.64%Claude Opus 4.8 · Claude Code · max Terminal-Bench public leaderboard · benchmark-publisher Run: 2026-05-28 · 4-0-0/952b4217-421f-4d14-849b-9968fcb2063b Published model + agent result; agents differ across models. Not a controlled model-only evaluation. Reported trials: 330. Source 95% accuracy interval half-width: 3.56 pp; this is not a DC Power interval. Inspect source ↗Attributed public leaderboard score facts · Terminal-Bench | max / Terminal-Bench 4.0 · Claude Code | Terminal-Bench ↗ |
|---|