| GPQA diamondKnowledge | 95.58%claude-sonnet-5-5_max Epoch AI evaluation · epoch-run Run: 2026-09-29 · gpqa_diamond.csv Reported standard error: ±1.37 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tiers-1-3-v2-PrivateReasoning | 88.77%claude-sonnet-5-5_max Epoch AI evaluation · epoch-run Run: 2026-09-29 · frontiermath_tiers_1_3_v2.csv Reported standard error: ±1.87 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tier-4-v2-PrivateReasoning | 80.49%claude-sonnet-5-5_max Epoch AI evaluation · epoch-run Run: 2026-09-29 · frontiermath_tier_4_v2.csv Reported standard error: ±6.27 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 100.00%claude-sonnet-5-5_max Epoch AI evaluation · epoch-run Run: 2026-09-29 · otis_mock_aime_2024_2025.csv Reported standard error: ±0.00 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| SimpleQA VerifiedKnowledge | 46.50%claude-sonnet-5-5_max Epoch AI evaluation · epoch-run Run: 2026-09-29 · simpleqa_verified.csv Reported standard error: ±1.58 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| Chess PuzzlesReasoning | 59.00%claude-sonnet-5-5_max Epoch AI evaluation · epoch-run Run: 2026-10-13 · chess_puzzles.csv Reported standard error: ±4.94 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| Mystery Game PuzzlesReasoning | 65.00%claude-sonnet-5-5_max Epoch AI evaluation · epoch-run Run: 2026-09-29 · mystery_game_puzzles.csv Reported standard error: ±4.79 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| ARC-AGIReasoning | 96.50%claude-sonnet-5-5_max https://arcprize.org/leaderboard · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 96.50%claude-sonnet-5-5_xhigh https://arcprize.org/leaderboard · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | xhigh / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 92.00%claude-sonnet-5-5_high https://arcprize.org/leaderboard · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 70.00%claude-sonnet-5-5_medium https://arcprize.org/leaderboard · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 67.00%claude-sonnet-5-5_low https://arcprize.org/leaderboard · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| APEX-AgentsAgents | 75.50%claude-sonnet-5-5_max External result; evaluator not specified · external Run: Date not supplied · apex_agents_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| APEX-AgentsAgents | 44.60%claude-sonnet-5-5_medium External result; evaluator not specified · external Run: Date not supplied · apex_agents_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 83.89%claude-sonnet-5-5_xhigh External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | xhigh / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 67.36%claude-sonnet-5-5_high External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 32.78%claude-sonnet-5-5_medium External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 24.03%claude-sonnet-5-5_low External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| HLEKnowledge | 46.12%claude-sonnet-5-5_xhigh External result; evaluator not specified · external Run: Date not supplied · hle_external.csv Reported standard error: ±1.95 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | xhigh / Not reported | External · via Epoch ↗ |
|---|
| CursorBenchOther | 55.50%claude-sonnet-5-5_max https://cursor.com/cursorbench · external Run: Date not supplied · cursorbench_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| CursorBenchOther | 53.10%claude-sonnet-5-5_xhigh https://cursor.com/cursorbench · external Run: Date not supplied · cursorbench_external.csv Inspect source ↗CC BY 4.0 | xhigh / Not reported | External · via Epoch ↗ |
|---|
| CursorBenchOther | 47.80%claude-sonnet-5-5_high https://cursor.com/cursorbench · external Run: Date not supplied · cursorbench_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| CursorBenchOther | 39.20%claude-sonnet-5-5_medium https://cursor.com/cursorbench · external Run: Date not supplied · cursorbench_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| CursorBenchOther | 35.80%claude-sonnet-5-5_low https://cursor.com/cursorbench · external Run: Date not supplied · cursorbench_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| CritPtOther | 31.43%claude-sonnet-5-5_max External result; evaluator not specified · external Run: Date not supplied · critpt_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| CritPtOther | 31.14%claude-sonnet-5-5_xhigh External result; evaluator not specified · external Run: Date not supplied · critpt_external.csv Inspect source ↗CC BY 4.0 | xhigh / Not reported | External · via Epoch ↗ |
|---|
| CritPtOther | 24.57%claude-sonnet-5-5_high External result; evaluator not specified · external Run: Date not supplied · critpt_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| CritPtOther | 16.86%claude-sonnet-5-5_medium External result; evaluator not specified · external Run: Date not supplied · critpt_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| CritPtOther | 11.43%claude-sonnet-5-5_low External result; evaluator not specified · external Run: Date not supplied · critpt_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| ProofBenchReasoning | 100.00%claude-sonnet-5-5_max https://www.vals.ai/benchmarks/proof_bench · external Run: Date not supplied · proofbench_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| FrontierCodeCoding | 52.09%claude-sonnet-5-5_xhigh https://cognition.com/frontiercode · external Run: Date not supplied · frontiercode_external.csv Inspect source ↗CC BY 4.0 | xhigh / claude-code | External · via Epoch ↗ |
|---|
| LMCAReasoning | 68.26%claude-sonnet-5-5_max https://conceptualreasoning.ai/lmca · external Run: Date not supplied · lmca_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| LMCAReasoning | 66.32%claude-sonnet-5-5_xhigh https://conceptualreasoning.ai/lmca · external Run: Date not supplied · lmca_external.csv Inspect source ↗CC BY 4.0 | xhigh / Not reported | External · via Epoch ↗ |
|---|
| LMCAReasoning | 65.45%claude-sonnet-5-5_medium https://conceptualreasoning.ai/lmca · external Run: Date not supplied · lmca_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| LMCAReasoning | 65.93%claude-sonnet-5-5_high https://conceptualreasoning.ai/lmca · external Run: Date not supplied · lmca_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| LMCAReasoning | 64.54%claude-sonnet-5-5_low https://conceptualreasoning.ai/lmca · external Run: Date not supplied · lmca_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| DTBenchReasoning | 97.33%claude-sonnet-5-5_max https://conceptualreasoning.ai/dtbench · external Run: Date not supplied · dtbench_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| DTBenchReasoning | 96.00%claude-sonnet-5-5_xhigh https://conceptualreasoning.ai/dtbench · external Run: Date not supplied · dtbench_external.csv Inspect source ↗CC BY 4.0 | xhigh / Not reported | External · via Epoch ↗ |
|---|
| DTBenchReasoning | 93.87%claude-sonnet-5-5_medium https://conceptualreasoning.ai/dtbench · external Run: Date not supplied · dtbench_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| DTBenchReasoning | 94.13%claude-sonnet-5-5_high https://conceptualreasoning.ai/dtbench · external Run: Date not supplied · dtbench_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| DTBenchReasoning | 93.33%claude-sonnet-5-5_low https://conceptualreasoning.ai/dtbench · external Run: Date not supplied · dtbench_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| FrontierMath-ErdosReasoning | 2.90%claude-sonnet-5-5_max Epoch AI evaluation · epoch-run Run: 2026-10-08 · frontiermath_erdos.csv Reported standard error: ±2.10 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| Furniture AssemblyReasoning | 75.00%claude-sonnet-5-5_max Epoch AI evaluation · epoch-run Run: 2026-09-29 · furniture_assembly.csv Reported standard error: ±5.51 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| GDP.pdfOther | 31.40%claude-sonnet-5-5_max https://surgehq.ai/benchmarks/gdp-pdf · external Run: Date not supplied · gdp_pdf_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| FrontierSWECoding | 61.89%claude-sonnet-5-5_max https://www.frontierswe.com/ · external Run: Date not supplied · frontierswe_external.csv Inspect source ↗CC BY 4.0 | max / proximus | External · via Epoch ↗ |
|---|
| WeirdML v3Coding | 36.99%claude-sonnet-5-5_xhigh https://htihle.github.io/weirdml.html · external Run: Date not supplied · weirdml_v3_external.csv Inspect source ↗CC BY 4.0 | xhigh / claude_code | External · via Epoch ↗ |
|---|
| SpireClimb (Slay the Spire 1, Ascension 20 Heart)Other | 0.00%claude-sonnet-5-5_max Epoch AI evaluation · epoch-run Run: 2026-11-05 · spireclimb_sts1_a20_heart.csv Reported standard error: ±0.00 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| SpireClimb (Slay the Spire 2, Ascension 10)Other | 2.67%claude-sonnet-5-5_max Epoch AI evaluation · epoch-run Run: 2026-09-29 · spireclimb_sts2_a10.csv Reported standard error: ±1.87 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| SpireClimbOther | 1.33%claude-sonnet-5-5_max Epoch AI evaluation · epoch-run Run: 2026-11-05 · spireclimb.csv Reported standard error: ±0.94 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| LiveBench 2 Coding · 20261025Coding | 94.70%claude-sonnet-5.5 · max · LiveBench 2 20261025 LiveBench · independent-run Run: Date not supplied · 20261025/table.csv Benchmark edition 25 October 2026; individual run date not supplied. One run per model; mean task score. Failed/unmeasurable tasks score zero in the source. Source effort metadata is preserved. Inspect source ↗Attributed public leaderboard score facts · LiveBench | max / LiveBench 2 · 20261025 | LiveBench ↗ |
|---|
| LiveBench 2 Reasoning · 20261025Reasoning | 91.60%claude-sonnet-5.5 · max · LiveBench 2 20261025 LiveBench · independent-run Run: Date not supplied · 20261025/table.csv Benchmark edition 25 October 2026; individual run date not supplied. One run per model; mean task score. Failed/unmeasurable tasks score zero in the source. Source effort metadata is preserved. Inspect source ↗Attributed public leaderboard score facts · LiveBench | max / LiveBench 2 · 20261025 | LiveBench ↗ |
|---|
| LiveBench 2 Long Agentic · 20261025Agents | 63.40%claude-sonnet-5.5 · max · LiveBench 2 20261025 LiveBench · independent-run Run: Date not supplied · 20261025/table.csv Benchmark edition 25 October 2026; individual run date not supplied. One run per model; mean task score. Failed/unmeasurable tasks score zero in the source. Source effort metadata is preserved. Inspect source ↗Attributed public leaderboard score facts · LiveBench | max / LiveBench 2 · 20261025 | LiveBench ↗ |
|---|
| Terminal-Bench 4.0Agents | 61.82%Claude Sonnet 5.5 · Claude Code · max Terminal-Bench public leaderboard · benchmark-publisher Run: 2026-09-28 · 4-0-0/723c6609-fe18-46d9-a1a3-dd4b6b0e0d00 Published model + agent result; agents differ across models. Not a controlled model-only evaluation. Reported trials: 330. Source 95% accuracy interval half-width: 2.94 pp; this is not a DC Power interval. Inspect source ↗Attributed public leaderboard score facts · Terminal-Bench | max / Terminal-Bench 4.0 · Claude Code | Terminal-Bench ↗ |
|---|
| ARC-AGI-2 · semi-privateReasoning | 83.89%Claude Sonnet 5.5 (XHigh) ARC Prize official leaderboard · benchmark-publisher Run: Date not supplied · evaluations.json · v2_Semi_Private Reported benchmark cost: $0.546199 per task. Different from the token-workload estimate. Semi-private split only. Provider-adapter and custom-scaffold families are kept separate. Identical effort names do not imply identical compute budgets. Inspect source ↗Public leaderboard facts · ARC Prize | xhigh / ARC Prize leaderboard baseline | ARC Prize ↗ |
|---|
| ARC-AGI-2 · semi-privateReasoning | 67.36%Claude Sonnet 5.5 (High) ARC Prize official leaderboard · benchmark-publisher Run: Date not supplied · evaluations.json · v2_Semi_Private Reported benchmark cost: $0.276755 per task. Different from the token-workload estimate. Semi-private split only. Provider-adapter and custom-scaffold families are kept separate. Identical effort names do not imply identical compute budgets. Inspect source ↗Public leaderboard facts · ARC Prize | high / ARC Prize leaderboard baseline | ARC Prize ↗ |
|---|
| ARC-AGI-2 · semi-privateReasoning | 32.78%Claude Sonnet 5.5 (Medium) ARC Prize official leaderboard · benchmark-publisher Run: Date not supplied · evaluations.json · v2_Semi_Private Reported benchmark cost: $0.155375 per task. Different from the token-workload estimate. Semi-private split only. Provider-adapter and custom-scaffold families are kept separate. Identical effort names do not imply identical compute budgets. Inspect source ↗Public leaderboard facts · ARC Prize | medium / ARC Prize leaderboard baseline | ARC Prize ↗ |
|---|
| ARC-AGI-2 · semi-privateReasoning | 24.03%Claude Sonnet 5.5 (Low) ARC Prize official leaderboard · benchmark-publisher Run: Date not supplied · evaluations.json · v2_Semi_Private Reported benchmark cost: $0.109235 per task. Different from the token-workload estimate. Semi-private split only. Provider-adapter and custom-scaffold families are kept separate. Identical effort names do not imply identical compute budgets. Inspect source ↗Public leaderboard facts · ARC Prize | low / ARC Prize leaderboard baseline | ARC Prize ↗ |
|---|