| GPQA diamondKnowledge | 78.79%claude-sonnet-4-6_max Epoch AI evaluation · epoch-run Run: 2026-08-06 · gpqa_diamond.csv Reported standard error: ±2.91 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| GPQA diamondKnowledge | 83.33%claude-sonnet-4-6_high Epoch AI evaluation · epoch-run Run: 2026-07-13 · gpqa_diamond.csv Reported standard error: ±2.66 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| GPQA diamondKnowledge | 83.33%claude-sonnet-4-6_medium Epoch AI evaluation · epoch-run Run: 2026-07-13 · gpqa_diamond.csv Reported standard error: ±2.66 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Epoch Inspect | Epoch AI run ↗ |
|---|
| GPQA diamondKnowledge | 87.37%claude-sonnet-4-6_32K Epoch AI evaluation · epoch-run Run: 2026-02-20 · gpqa_diamond.csv Reported standard error: ±2.00 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-2025-02-28-PrivateReasoning | 32.40%claude-sonnet-4-6_16K Epoch AI evaluation · epoch-run Run: 2026-02-20 · frontiermath.csv Reported standard error: ±2.81 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tier-4-2025-07-01-PrivateReasoning | 8.30%claude-sonnet-4-6_16K Epoch AI evaluation · epoch-run Run: 2026-02-21 · frontiermath_tier_4.csv Reported standard error: ±4.00 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 71.11%claude-sonnet-4-6_max Epoch AI evaluation · epoch-run Run: 2026-08-06 · otis_mock_aime_2024_2025.csv Reported standard error: ±6.83 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 75.56%claude-sonnet-4-6_high Epoch AI evaluation · epoch-run Run: 2026-07-13 · otis_mock_aime_2024_2025.csv Reported standard error: ±6.48 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 82.22%claude-sonnet-4-6_medium Epoch AI evaluation · epoch-run Run: 2026-07-13 · otis_mock_aime_2024_2025.csv Reported standard error: ±5.76 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 85.79%claude-sonnet-4-6_32K Epoch AI evaluation · epoch-run Run: 2026-02-20 · otis_mock_aime_2024_2025.csv Reported standard error: ±4.54 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| SWE-Bench verifiedCoding | 75.21%claude-sonnet-4-6 Epoch AI evaluation · epoch-run Run: 2026-02-21 · swe_bench_verified.csv Reported standard error: ±1.96 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| SimpleQA VerifiedKnowledge | 32.80%claude-sonnet-4-6_max Epoch AI evaluation · epoch-run Run: 2026-08-27 · simpleqa_verified.csv Reported standard error: ±1.49 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| SimpleQA VerifiedKnowledge | 35.50%claude-sonnet-4-6_high Epoch AI evaluation · epoch-run Run: 2026-08-10 · simpleqa_verified.csv Reported standard error: ±1.51 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| Chess PuzzlesReasoning | 23.00%claude-sonnet-4-6_max Epoch AI evaluation · epoch-run Run: 2026-10-13 · chess_puzzles.csv Reported standard error: ±4.23 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| Chess PuzzlesReasoning | 19.00%claude-sonnet-4-6_high Epoch AI evaluation · epoch-run Run: 2026-10-13 · chess_puzzles.csv Reported standard error: ±3.94 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| Chess PuzzlesReasoning | 16.00%claude-sonnet-4-6_medium Epoch AI evaluation · epoch-run Run: 2026-10-13 · chess_puzzles.csv Reported standard error: ±3.68 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Epoch Inspect | Epoch AI run ↗ |
|---|
| Mystery Game PuzzlesReasoning | 14.00%claude-sonnet-4-6 Epoch AI evaluation · epoch-run Run: 2026-08-06 · mystery_game_puzzles.csv Reported standard error: ±3.49 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Epoch Inspect | Epoch AI run ↗ |
|---|
| Mystery Game PuzzlesReasoning | 16.00%claude-sonnet-4-6_low Epoch AI evaluation · epoch-run Run: 2026-08-06 · mystery_game_puzzles.csv Reported standard error: ±3.68 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | low / Epoch Inspect | Epoch AI run ↗ |
|---|
| ARC-AGIReasoning | 86.50%claude-sonnet-4-6_high External result; evaluator not specified · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 86.00%claude-sonnet-4-6_max External result; evaluator not specified · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| DeepResearch BenchAgents | 54.90%claude-sonnet-4-6_high https://evals.futuresearch.ai/#drb · external Run: Date not supplied · deepresearchbench_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| DeepResearch BenchAgents | 50.40%claude-sonnet-4-6_low https://evals.futuresearch.ai/#drb · external Run: Date not supplied · deepresearchbench_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| OSWorldAgents | 72.10%claude-sonnet-4-6 OS World Website · external Run: Date not supplied · os_world_external.csv Inspect source ↗CC BY 4.0 | unspecified / claude-sonnet-4-6 (100 steps) | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 53.43%claude-sonnet-4-6_unknown https://www.tbench.ai/leaderboard/terminal-bench/2.0 · external Run: 2026-02-17 · terminalbench_external.csv Reported standard error: ±2.83 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unknown / Simplai Agent | External · via Epoch ↗ |
|---|
| Terminal BenchCoding | 53.40%claude-sonnet-4-6 External result; evaluator not specified · external Run: 2026-05-14 · terminalbench_external.csv Reported standard error: ±2.80 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | unspecified / Simplai Agent | External · via Epoch ↗ |
|---|
| WeirdMLCoding | 66.07%claude-sonnet-4-6_medium WeirdML Leaderboard · external Run: Date not supplied · weirdml_external.csv Reported standard error: ±0.03 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| APEX-AgentsAgents | 43.00%claude-sonnet-4-6_high External result; evaluator not specified · external Run: Date not supplied · apex_agents_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 60.42%claude-sonnet-4-6_high External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 58.33%claude-sonnet-4-6_max External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| GBAEvalOther | 48.76%claude-sonnet-4-6_unknown https://gbaeval.com/model/claude-sonnet · external Run: Date not supplied · gbaeval_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| CritPtOther | 3.14%claude-sonnet-4-6_max External result; evaluator not specified · external Run: Date not supplied · critpt_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| ExploitBenchCoding | 23.60%claude-sonnet-4-6 External result; evaluator not specified · external Run: Date not supplied · exploitbench_external.csv Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| ExploitBenchCoding | 22.70%claude-sonnet-4-6 External result; evaluator not specified · external Run: Date not supplied · exploitbench_external.csv Inspect source ↗CC BY 4.0 | unspecified / Not reported | External · via Epoch ↗ |
|---|
| OSWorld 2.0Agents | 9.30%claude-sonnet-4-6_medium https://osworld-v2.xlang.ai/ · external Run: Date not supplied · osworld_2_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| OSWorld 2.0Agents | 8.30%claude-sonnet-4-6_max https://osworld-v2.xlang.ai/ · external Run: Date not supplied · osworld_2_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| DeepSWECoding | 29.93%claude-sonnet-4-6_high https://deepswe.datacurve.ai/ · external Run: Date not supplied · deepswe_external.csv Inspect source ↗CC BY 4.0 | high / mini-swe-agent | External · via Epoch ↗ |
|---|
| ProofBenchReasoning | 45.00%claude-sonnet-4-6_max https://www.vals.ai/benchmarks/proof_bench · external Run: Date not supplied · proofbench_external.csv Reported standard error: ±4.97 pp. This is not a 90% interval. ProofBench v1.0-era value; model absent from the v1.1 board (vals.ai re-grade 2026-08-14, methodology changed) and not re-run. Not comparable to v1.1 rows. Annotated 2026-08-18. Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| FrontierCodeCoding | 24.31%claude-sonnet-4-6_unknown https://cognition.com/frontiercode · external Run: Date not supplied · frontiercode_external.csv Inspect source ↗CC BY 4.0 | unknown / claude-code | External · via Epoch ↗ |
|---|
| LMCAReasoning | 46.51%claude-sonnet-4-6_max https://conceptualreasoning.ai/lmca · external Run: Date not supplied · lmca_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| DTBenchReasoning | 89.87%claude-sonnet-4-6_max https://conceptualreasoning.ai/dtbench · external Run: Date not supplied · dtbench_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| GDP.pdfOther | 18.00%claude-sonnet-4-6_max https://surgehq.ai/benchmarks/gdp-pdf · external Run: Date not supplied · gdp_pdf_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2 · semi-privateReasoning | 58.33%Claude Sonnet 4.6 (Max) ARC Prize official leaderboard · benchmark-publisher Run: Date not supplied · evaluations.json · v2_Semi_Private Reported benchmark cost: $2.7179 per task. Different from the token-workload estimate. Semi-private split only. Provider-adapter and custom-scaffold families are kept separate. Identical effort names do not imply identical compute budgets. Inspect source ↗Public leaderboard facts · ARC Prize | max / ARC Prize leaderboard baseline | ARC Prize ↗ |
|---|
| ARC-AGI-2 · semi-privateReasoning | 60.42%Claude Sonnet 4.6 (High) ARC Prize official leaderboard · benchmark-publisher Run: Date not supplied · evaluations.json · v2_Semi_Private Reported benchmark cost: $2.6966 per task. Different from the token-workload estimate. Semi-private split only. Provider-adapter and custom-scaffold families are kept separate. Identical effort names do not imply identical compute budgets. Inspect source ↗Public leaderboard facts · ARC Prize | high / ARC Prize leaderboard baseline | ARC Prize ↗ |
|---|