| GPQA diamondKnowledge | 92.74%grok-4.7_xhigh Epoch AI evaluation · epoch-run Run: 2026-09-22 · gpqa_diamond.csv Reported standard error: ±1.55 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | xhigh / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tiers-1-3-v2-PrivateReasoning | 52.98%grok-4.7_xhigh Epoch AI evaluation · epoch-run Run: 2026-09-22 · frontiermath_tiers_1_3_v2.csv Reported standard error: ±2.96 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | xhigh / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tier-4-v2-PrivateReasoning | 17.07%grok-4.7_xhigh Epoch AI evaluation · epoch-run Run: 2026-09-22 · frontiermath_tier_4_v2.csv Reported standard error: ±5.95 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | xhigh / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 98.06%grok-4.7_xhigh Epoch AI evaluation · epoch-run Run: 2026-09-22 · otis_mock_aime_2024_2025.csv Reported standard error: ±1.43 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | xhigh / Epoch Inspect | Epoch AI run ↗ |
|---|
| SimpleQA VerifiedKnowledge | 56.00%grok-4.7_xhigh Epoch AI evaluation · epoch-run Run: 2026-09-22 · simpleqa_verified.csv Reported standard error: ±1.57 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | xhigh / Epoch Inspect | Epoch AI run ↗ |
|---|
| Chess PuzzlesReasoning | 41.00%grok-4.7_xhigh Epoch AI evaluation · epoch-run Run: 2026-10-13 · chess_puzzles.csv Reported standard error: ±4.94 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | xhigh / Epoch Inspect | Epoch AI run ↗ |
|---|
| Mystery Game PuzzlesReasoning | 29.00%grok-4.7_xhigh Epoch AI evaluation · epoch-run Run: 2026-09-22 · mystery_game_puzzles.csv Reported standard error: ±4.56 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | xhigh / Epoch Inspect | Epoch AI run ↗ |
|---|
| ARC-AGIReasoning | 90.17%grok-4.7_high https://arcprize.org/leaderboard · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 90.00%grok-4.7_medium https://arcprize.org/leaderboard · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 89.50%grok-4.7_xhigh https://arcprize.org/leaderboard · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | xhigh / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 63.33%grok-4.7_low https://arcprize.org/leaderboard · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| APEX-AgentsAgents | 54.60%grok-4.7_unknown External result; evaluator not specified · external Run: Date not supplied · apex_agents_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 61.39%grok-4.7_xhigh External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | xhigh / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 58.75%grok-4.7_medium External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 58.33%grok-4.7_high External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 16.67%grok-4.7_low External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| CursorBenchOther | 46.30%grok-4.7_xhigh https://cursor.com/cursorbench · external Run: Date not supplied · cursorbench_external.csv Inspect source ↗CC BY 4.0 | xhigh / Not reported | External · via Epoch ↗ |
|---|
| CursorBenchOther | 43.90%grok-4.7_high https://cursor.com/cursorbench · external Run: Date not supplied · cursorbench_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| CursorBenchOther | 41.60%grok-4.7_medium https://cursor.com/cursorbench · external Run: Date not supplied · cursorbench_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| CursorBenchOther | 33.10%grok-4.7_low https://cursor.com/cursorbench · external Run: Date not supplied · cursorbench_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| CritPtOther | 18.00%grok-4.7_high External result; evaluator not specified · external Run: Date not supplied · critpt_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| CritPtOther | 17.71%grok-4.7_xhigh External result; evaluator not specified · external Run: Date not supplied · critpt_external.csv Inspect source ↗CC BY 4.0 | xhigh / Not reported | External · via Epoch ↗ |
|---|
| CritPtOther | 13.43%grok-4.7_low External result; evaluator not specified · external Run: Date not supplied · critpt_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| ProofBenchReasoning | 26.00%grok-4.7_unknown https://www.vals.ai/benchmarks/proof_bench · external Run: Date not supplied · proofbench_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| FrontierCodeCoding | 47.59%grok-4.7_unknown https://cognition.com/frontiercode · external Run: Date not supplied · frontiercode_external.csv Inspect source ↗CC BY 4.0 | unknown / grok-build | External · via Epoch ↗ |
|---|
| LMCAReasoning | 49.38%grok-4.7_xhigh https://conceptualreasoning.ai/lmca · external Run: Date not supplied · lmca_external.csv Inspect source ↗CC BY 4.0 | xhigh / Not reported | External · via Epoch ↗ |
|---|
| DTBenchReasoning | 96.00%grok-4.7_xhigh https://conceptualreasoning.ai/dtbench · external Run: Date not supplied · dtbench_external.csv Inspect source ↗CC BY 4.0 | xhigh / Not reported | External · via Epoch ↗ |
|---|
| FrontierMath-ErdosReasoning | 0.00%grok-4.7_xhigh Epoch AI evaluation · epoch-run Run: 2026-09-21 · frontiermath_erdos.csv Reported standard error: ±0.00 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | xhigh / Epoch Inspect | Epoch AI run ↗ |
|---|
| Furniture AssemblyReasoning | 20.83%grok-4.7_xhigh Epoch AI evaluation · epoch-run Run: 2026-09-24 · furniture_assembly.csv Reported standard error: ±5.22 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | xhigh / Epoch Inspect | Epoch AI run ↗ |
|---|
| GDP.pdfOther | 22.80%grok-4.7_xhigh https://surgehq.ai/benchmarks/gdp-pdf · external Run: Date not supplied · gdp_pdf_external.csv Inspect source ↗CC BY 4.0 | xhigh / Not reported | External · via Epoch ↗ |
|---|
| FrontierSWECoding | 29.50%grok-4.7_xhigh https://www.frontierswe.com/ · external Run: Date not supplied · frontierswe_external.csv Inspect source ↗CC BY 4.0 | xhigh / proximus | External · via Epoch ↗ |
|---|
| WeirdML v3Coding | 18.73%grok-4.7_xhigh https://htihle.github.io/weirdml.html · external Run: Date not supplied · weirdml_v3_external.csv Inspect source ↗CC BY 4.0 | xhigh / codex_cli | External · via Epoch ↗ |
|---|
| LiveBench 2 Coding · 20261025Coding | 84.50%grok-4.7 · xhigh · LiveBench 2 20261025 LiveBench · independent-run Run: Date not supplied · 20261025/table.csv Benchmark edition 25 October 2026; individual run date not supplied. One run per model; mean task score. Failed/unmeasurable tasks score zero in the source. Source effort metadata is preserved. Inspect source ↗Attributed public leaderboard score facts · LiveBench | xhigh / LiveBench 2 · 20261025 | LiveBench ↗ |
|---|
| LiveBench 2 Reasoning · 20261025Reasoning | 82.70%grok-4.7 · xhigh · LiveBench 2 20261025 LiveBench · independent-run Run: Date not supplied · 20261025/table.csv Benchmark edition 25 October 2026; individual run date not supplied. One run per model; mean task score. Failed/unmeasurable tasks score zero in the source. Source effort metadata is preserved. Inspect source ↗Attributed public leaderboard score facts · LiveBench | xhigh / LiveBench 2 · 20261025 | LiveBench ↗ |
|---|
| LiveBench 2 Long Agentic · 20261025Agents | 46.10%grok-4.7 · xhigh · LiveBench 2 20261025 LiveBench · independent-run Run: Date not supplied · 20261025/table.csv Benchmark edition 25 October 2026; individual run date not supplied. One run per model; mean task score. Failed/unmeasurable tasks score zero in the source. Source effort metadata is preserved. Inspect source ↗Attributed public leaderboard score facts · LiveBench | xhigh / LiveBench 2 · 20261025 | LiveBench ↗ |
|---|
| Terminal-Bench 4.0Agents | 37.58%Grok 4.7 · Grok Build · xhigh Terminal-Bench public leaderboard · benchmark-publisher Run: 2026-09-21 · 4-0-0/84b39f56-fe3c-46c3-919f-3b67b73f9b49 Published model + agent result; agents differ across models. Not a controlled model-only evaluation. Reported trials: 330. Source 95% accuracy interval half-width: 3.54 pp; this is not a DC Power interval. Inspect source ↗Attributed public leaderboard score facts · Terminal-Bench | xhigh / Terminal-Bench 4.0 · Grok Build | Terminal-Bench ↗ |
|---|
| ARC-AGI-2 · semi-privateReasoning | 61.39%Grok 4.7 (XHigh) ARC Prize official leaderboard · benchmark-publisher Run: Date not supplied · evaluations.json · v2_Semi_Private Reported benchmark cost: $2.014906 per task. Different from the token-workload estimate. Semi-private split only. Provider-adapter and custom-scaffold families are kept separate. Identical effort names do not imply identical compute budgets. Inspect source ↗Public leaderboard facts · ARC Prize | xhigh / ARC Prize leaderboard baseline | ARC Prize ↗ |
|---|
| ARC-AGI-2 · semi-privateReasoning | 58.33%Grok 4.7 (High) ARC Prize official leaderboard · benchmark-publisher Run: Date not supplied · evaluations.json · v2_Semi_Private Reported benchmark cost: $1.549013 per task. Different from the token-workload estimate. Semi-private split only. Provider-adapter and custom-scaffold families are kept separate. Identical effort names do not imply identical compute budgets. Inspect source ↗Public leaderboard facts · ARC Prize | high / ARC Prize leaderboard baseline | ARC Prize ↗ |
|---|
| ARC-AGI-2 · semi-privateReasoning | 58.75%Grok 4.7 (Medium) ARC Prize official leaderboard · benchmark-publisher Run: Date not supplied · evaluations.json · v2_Semi_Private Reported benchmark cost: $1.47591 per task. Different from the token-workload estimate. Semi-private split only. Provider-adapter and custom-scaffold families are kept separate. Identical effort names do not imply identical compute budgets. Inspect source ↗Public leaderboard facts · ARC Prize | medium / ARC Prize leaderboard baseline | ARC Prize ↗ |
|---|
| ARC-AGI-2 · semi-privateReasoning | 16.67%Grok 4.7 (Low) ARC Prize official leaderboard · benchmark-publisher Run: Date not supplied · evaluations.json · v2_Semi_Private Reported benchmark cost: $0.173698 per task. Different from the token-workload estimate. Semi-private split only. Provider-adapter and custom-scaffold families are kept separate. Identical effort names do not imply identical compute budgets. Inspect source ↗Public leaderboard facts · ARC Prize | low / ARC Prize leaderboard baseline | ARC Prize ↗ |
|---|