| GPQA diamondKnowledge | 85.86%gemini-3.6-flash_minimal Epoch AI evaluation · epoch-run Run: 2026-08-07 · gpqa_diamond.csv Reported standard error: ±2.48 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | minimal / Epoch Inspect | Epoch AI run ↗ |
|---|
| GPQA diamondKnowledge | 86.36%gemini-3.6-flash_low Epoch AI evaluation · epoch-run Run: 2026-08-06 · gpqa_diamond.csv Reported standard error: ±2.45 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | low / Epoch Inspect | Epoch AI run ↗ |
|---|
| GPQA diamondKnowledge | 94.13%gemini-3.6-flash_high Epoch AI evaluation · epoch-run Run: 2026-08-02 · gpqa_diamond.csv Reported standard error: ±1.40 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tiers-1-3-v2-PrivateReasoning | 58.95%gemini-3.6-flash_high Epoch AI evaluation · epoch-run Run: 2026-08-02 · frontiermath_tiers_1_3_v2.csv Reported standard error: ±2.92 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tier-4-v2-PrivateReasoning | 21.95%gemini-3.6-flash_high Epoch AI evaluation · epoch-run Run: 2026-08-02 · frontiermath_tier_4_v2.csv Reported standard error: ±6.54 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 80.00%gemini-3.6-flash_minimal Epoch AI evaluation · epoch-run Run: 2026-08-07 · otis_mock_aime_2024_2025.csv Reported standard error: ±6.03 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | minimal / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 82.22%gemini-3.6-flash_low Epoch AI evaluation · epoch-run Run: 2026-08-07 · otis_mock_aime_2024_2025.csv Reported standard error: ±5.76 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | low / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 94.17%gemini-3.6-flash_high Epoch AI evaluation · epoch-run Run: 2026-08-02 · otis_mock_aime_2024_2025.csv Reported standard error: ±3.09 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| SimpleQA VerifiedKnowledge | 66.20%gemini-3.6-flash_high Epoch AI evaluation · epoch-run Run: 2026-08-27 · simpleqa_verified.csv Reported standard error: ±1.50 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| Chess PuzzlesReasoning | 40.00%gemini-3.6-flash_high Epoch AI evaluation · epoch-run Run: 2026-10-13 · chess_puzzles.csv Reported standard error: ±4.92 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| Chess PuzzlesReasoning | 42.00%gemini-3.6-flash_low Epoch AI evaluation · epoch-run Run: 2026-10-13 · chess_puzzles.csv Reported standard error: ±4.96 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | low / Epoch Inspect | Epoch AI run ↗ |
|---|
| Chess PuzzlesReasoning | 29.00%gemini-3.6-flash_minimal Epoch AI evaluation · epoch-run Run: 2026-10-13 · chess_puzzles.csv Reported standard error: ±4.56 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | minimal / Epoch Inspect | Epoch AI run ↗ |
|---|
| Mystery Game PuzzlesReasoning | 25.00%gemini-3.6-flash_minimal Epoch AI evaluation · epoch-run Run: 2026-08-05 · mystery_game_puzzles.csv Reported standard error: ±4.35 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | minimal / Epoch Inspect | Epoch AI run ↗ |
|---|
| Mystery Game PuzzlesReasoning | 23.00%gemini-3.6-flash_low Epoch AI evaluation · epoch-run Run: 2026-08-05 · mystery_game_puzzles.csv Reported standard error: ±4.23 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | low / Epoch Inspect | Epoch AI run ↗ |
|---|
| Mystery Game PuzzlesReasoning | 30.00%gemini-3.6-flash_high Epoch AI evaluation · epoch-run Run: 2026-08-05 · mystery_game_puzzles.csv Reported standard error: ±4.61 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| ARC-AGIReasoning | 91.17%gemini-3.6-flash_high https://arcprize.org/leaderboard · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 83.17%gemini-3.6-flash_medium https://arcprize.org/leaderboard · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 76.50%gemini-3.6-flash_low https://arcprize.org/leaderboard · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 34.50%gemini-3.6-flash_minimal https://arcprize.org/leaderboard · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | minimal / Not reported | External · via Epoch ↗ |
|---|
| WeirdMLCoding | 56.10%gemini-3.6-flash_high https://htihle.github.io/weirdml.html · external Run: Date not supplied · weirdml_external.csv Reported standard error: ±0.03 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| APEX-AgentsAgents | 46.90%gemini-3.6-flash_unknown External result; evaluator not specified · external Run: Date not supplied · apex_agents_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 60.42%gemini-3.6-flash_high External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 50.42%gemini-3.6-flash_medium External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | medium / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 30.42%gemini-3.6-flash_low External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 2.64%gemini-3.6-flash_minimal External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | minimal / Not reported | External · via Epoch ↗ |
|---|
| CritPtOther | 10.57%gemini-3.6-flash_high External result; evaluator not specified · external Run: Date not supplied · critpt_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| DeepSWECoding | 46.68%gemini-3.6-flash_high https://deepswe.datacurve.ai/ · external Run: Date not supplied · deepswe_external.csv Inspect source ↗CC BY 4.0 | high / mini-swe-agent | External · via Epoch ↗ |
|---|
| ProofBenchReasoning | 36.00%gemini-3.6-flash_unknown https://www.vals.ai/benchmarks/proof_bench · external Run: Date not supplied · proofbench_external.csv Reported standard error: ±4.82 pp. This is not a 90% interval. ProofBench v1.0-era value; model absent from the v1.1 board (vals.ai re-grade 2026-08-14, methodology changed) and not re-run. Not comparable to v1.1 rows. Annotated 2026-08-18. Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| FrontierCodeCoding | 34.37%gemini-3.6-flash_unknown https://cognition.com/frontiercode · external Run: Date not supplied · frontiercode_external.csv Inspect source ↗CC BY 4.0 | unknown / devin-cli | External · via Epoch ↗ |
|---|
| LMCAReasoning | 44.93%gemini-3.6-flash_high https://conceptualreasoning.ai/lmca · external Run: Date not supplied · lmca_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| DTBenchReasoning | 95.47%gemini-3.6-flash_high https://conceptualreasoning.ai/dtbench · external Run: Date not supplied · dtbench_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| Furniture AssemblyReasoning | 23.33%gemini-3.6-flash_high Epoch AI evaluation · epoch-run Run: 2026-09-10 · furniture_assembly.csv Reported standard error: ±5.38 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| GDP.pdfOther | 14.00%gemini-3.6-flash_unknown https://surgehq.ai/benchmarks/gdp-pdf · external Run: Date not supplied · gdp_pdf_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| GDP.pdfOther | 14.00%gemini-3.6-flash_high https://surgehq.ai/benchmarks/gdp-pdf · external Run: Date not supplied · gdp_pdf_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2 · semi-privateReasoning | 60.42%Gemini 3.6 Flash (High) ARC Prize official leaderboard · benchmark-publisher Run: Date not supplied · evaluations.json · v2_Semi_Private Reported benchmark cost: $0.60608 per task. Different from the token-workload estimate. Semi-private split only. Provider-adapter and custom-scaffold families are kept separate. Identical effort names do not imply identical compute budgets. Inspect source ↗Public leaderboard facts · ARC Prize | high / ARC Prize leaderboard baseline | ARC Prize ↗ |
|---|
| ARC-AGI-2 · semi-privateReasoning | 50.42%Gemini 3.6 Flash (Medium) ARC Prize official leaderboard · benchmark-publisher Run: Date not supplied · evaluations.json · v2_Semi_Private Reported benchmark cost: $0.455509 per task. Different from the token-workload estimate. Semi-private split only. Provider-adapter and custom-scaffold families are kept separate. Identical effort names do not imply identical compute budgets. Inspect source ↗Public leaderboard facts · ARC Prize | medium / ARC Prize leaderboard baseline | ARC Prize ↗ |
|---|
| ARC-AGI-2 · semi-privateReasoning | 30.42%Gemini 3.6 Flash (Low) ARC Prize official leaderboard · benchmark-publisher Run: Date not supplied · evaluations.json · v2_Semi_Private Reported benchmark cost: $0.222978 per task. Different from the token-workload estimate. Semi-private split only. Provider-adapter and custom-scaffold families are kept separate. Identical effort names do not imply identical compute budgets. Inspect source ↗Public leaderboard facts · ARC Prize | low / ARC Prize leaderboard baseline | ARC Prize ↗ |
|---|
| ARC-AGI-2 · semi-privateReasoning | 2.64%Gemini 3.6 Flash (Minimal) ARC Prize official leaderboard · benchmark-publisher Run: Date not supplied · evaluations.json · v2_Semi_Private Reported benchmark cost: $0.070841 per task. Different from the token-workload estimate. Semi-private split only. Provider-adapter and custom-scaffold families are kept separate. Identical effort names do not imply identical compute budgets. Inspect source ↗Public leaderboard facts · ARC Prize | minimal / ARC Prize leaderboard baseline | ARC Prize ↗ |
|---|