| GPQA diamondKnowledge | 84.85%kimi-k3_low Epoch AI evaluation · epoch-run Run: 2026-08-07 · gpqa_diamond.csv Reported standard error: ±2.55 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | low / Epoch Inspect | Epoch AI run ↗ |
|---|
| GPQA diamondKnowledge | 91.92%kimi-k3_high Epoch AI evaluation · epoch-run Run: 2026-08-07 · gpqa_diamond.csv Reported standard error: ±1.94 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| GPQA diamondKnowledge | 93.12%kimi-k3_max Epoch AI evaluation · epoch-run Run: 2026-07-16 · gpqa_diamond.csv Reported standard error: ±1.49 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tiers-1-3-v2-PrivateReasoning | 72.18%kimi-k3_max Epoch AI evaluation · epoch-run Run: 2026-07-17 · frontiermath_tiers_1_3_v2.csv Reported standard error: ±2.66 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| FrontierMath-Tier-4-v2-PrivateReasoning | 39.02%kimi-k3_max Epoch AI evaluation · epoch-run Run: 2026-07-17 · frontiermath_tier_4_v2.csv Reported standard error: ±7.71 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 68.89%kimi-k3_low Epoch AI evaluation · epoch-run Run: 2026-08-07 · otis_mock_aime_2024_2025.csv Reported standard error: ±6.98 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | low / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 93.33%kimi-k3_high Epoch AI evaluation · epoch-run Run: 2026-08-07 · otis_mock_aime_2024_2025.csv Reported standard error: ±3.76 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| OTIS Mock AIME 2024-2025Reasoning | 97.22%kimi-k3_max Epoch AI evaluation · epoch-run Run: 2026-07-16 · otis_mock_aime_2024_2025.csv Reported standard error: ±1.12 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| SimpleQA VerifiedKnowledge | 50.60%kimi-k3_max Epoch AI evaluation · epoch-run Run: 2026-08-27 · simpleqa_verified.csv Reported standard error: ±1.58 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| Chess PuzzlesReasoning | 36.00%kimi-k3_max Epoch AI evaluation · epoch-run Run: 2026-10-13 · chess_puzzles.csv Reported standard error: ±4.82 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| Chess PuzzlesReasoning | 37.00%kimi-k3_high Epoch AI evaluation · epoch-run Run: 2026-10-13 · chess_puzzles.csv Reported standard error: ±4.85 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | high / Epoch Inspect | Epoch AI run ↗ |
|---|
| Chess PuzzlesReasoning | 18.00%kimi-k3_low Epoch AI evaluation · epoch-run Run: 2026-10-13 · chess_puzzles.csv Reported standard error: ±3.86 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | low / Epoch Inspect | Epoch AI run ↗ |
|---|
| Mystery Game PuzzlesReasoning | 12.00%kimi-k3_low Epoch AI evaluation · epoch-run Run: 2026-08-29 · mystery_game_puzzles.csv Reported standard error: ±3.27 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | low / Epoch Inspect | Epoch AI run ↗ |
|---|
| Mystery Game PuzzlesReasoning | 26.00%kimi-k3_max Epoch AI evaluation · epoch-run Run: 2026-07-29 · mystery_game_puzzles.csv Reported standard error: ±4.41 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| ARC-AGIReasoning | 94.50%kimi-k3_max https://arcprize.org/leaderboard · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 86.67%kimi-k3_high https://arcprize.org/leaderboard · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGIReasoning | 65.67%kimi-k3_low https://arcprize.org/leaderboard · external Run: Date not supplied · arc_agi_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| SimpleBenchReasoning | 60.70%kimi-k3_max https://lmcouncil.ai/benchmarks · external Run: Date not supplied · simplebench_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| WeirdMLCoding | 82.57%kimi-k3_max https://htihle.github.io/weirdml.html · external Run: Date not supplied · weirdml_external.csv Reported standard error: ±0.01 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| APEX-AgentsAgents | 47.80%kimi-k3_unknown External result; evaluator not specified · external Run: Date not supplied · apex_agents_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 60.42%kimi-k3_max External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 55.00%kimi-k3_high External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | high / Not reported | External · via Epoch ↗ |
|---|
| ARC-AGI-2Reasoning | 12.36%kimi-k3_low External result; evaluator not specified · external Run: Date not supplied · arc_agi_2_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| PostTrainBenchCoding | 31.96%kimi-k3_unknown External result; evaluator not specified · external Run: Date not supplied · posttrainbench_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| GBAEvalOther | 48.35%kimi-k3_unknown https://gbaeval.com/model/kimi-k3 · external Run: Date not supplied · gbaeval_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| CritPtOther | 23.40%kimi-k3_max External result; evaluator not specified · external Run: Date not supplied · critpt_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| CritPtOther | 3.14%kimi-k3_low External result; evaluator not specified · external Run: Date not supplied · critpt_external.csv Inspect source ↗CC BY 4.0 | low / Not reported | External · via Epoch ↗ |
|---|
| Surface Evolver BenchOther | 93.00%kimi-k3_max https://yhenon.github.io/surface-evolver-llm-eval/ · external Run: Date not supplied · surface_evolver_bench_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| Surface Evolver BenchOther | 95.00%kimi-k3_unknown https://yhenon.github.io/surface-evolver-llm-eval/ · external Run: Date not supplied · surface_evolver_bench_external.csv Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| DeepSWECoding | 68.51%kimi-k3_max https://deepswe.datacurve.ai/ · external Run: Date not supplied · deepswe_external.csv Inspect source ↗CC BY 4.0 | max / mini-swe-agent | External · via Epoch ↗ |
|---|
| ProofBenchReasoning | 87.00%kimi-k3_unknown https://www.vals.ai/benchmarks/proof_bench · external Run: Date not supplied · proofbench_external.csv Reported standard error: ±3.38 pp. This is not a 90% interval. ProofBench v1.1 re-grade (vals.ai, 2026-08-14): corrected Lean formalizations + hardened grader (rejects sorry/admit shortcuts, larger elaboration budgets). Not comparable to v1.0-era values. Updated 2026-08-18 after multi-agent verification. Inspect source ↗CC BY 4.0 | unknown / Not reported | External · via Epoch ↗ |
|---|
| FrontierCodeCoding | 44.17%kimi-k3_unknown https://cognition.com/frontiercode · external Run: Date not supplied · frontiercode_external.csv Inspect source ↗CC BY 4.0 | unknown / mini-swe-agent | External · via Epoch ↗ |
|---|
| LMCAReasoning | 52.74%kimi-k3_max https://conceptualreasoning.ai/lmca · external Run: Date not supplied · lmca_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| DTBenchReasoning | 91.20%kimi-k3_max https://conceptualreasoning.ai/dtbench · external Run: Date not supplied · dtbench_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| FrontierMath-ErdosReasoning | 0.00%kimi-k3_max Epoch AI evaluation · epoch-run Run: 2026-08-28 · frontiermath_erdos.csv Reported standard error: ±0.00 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| Furniture AssemblyReasoning | 34.17%kimi-k3_max Epoch AI evaluation · epoch-run Run: 2026-09-11 · furniture_assembly.csv Reported standard error: ±6.12 pp. This is not a 90% interval. Inspect source ↗CC BY 4.0 | max / Epoch Inspect | Epoch AI run ↗ |
|---|
| GDP.pdfOther | 19.00%kimi-k3_max https://surgehq.ai/benchmarks/gdp-pdf · external Run: Date not supplied · gdp_pdf_external.csv Inspect source ↗CC BY 4.0 | max / Not reported | External · via Epoch ↗ |
|---|
| FrontierSWECoding | 25.87%kimi-k3_max https://www.frontierswe.com/ · external Run: Date not supplied · frontierswe_external.csv Inspect source ↗CC BY 4.0 | max / proximus | External · via Epoch ↗ |
|---|
| WeirdML v3Coding | 15.41%kimi-k3_high https://htihle.github.io/weirdml.html · external Run: Date not supplied · weirdml_v3_external.csv Inspect source ↗CC BY 4.0 | high / kimi_code | External · via Epoch ↗ |
|---|
| LiveBench 2 Coding · 20261025Coding | 59.30%kimi-k3 · max · LiveBench 2 20261025 LiveBench · independent-run Run: Date not supplied · 20261025/table.csv Benchmark edition 25 October 2026; individual run date not supplied. One run per model; mean task score. Failed/unmeasurable tasks score zero in the source. Source effort metadata is preserved. Inspect source ↗Attributed public leaderboard score facts · LiveBench | max / LiveBench 2 · 20261025 | LiveBench ↗ |
|---|
| LiveBench 2 Reasoning · 20261025Reasoning | 90.70%kimi-k3 · max · LiveBench 2 20261025 LiveBench · independent-run Run: Date not supplied · 20261025/table.csv Benchmark edition 25 October 2026; individual run date not supplied. One run per model; mean task score. Failed/unmeasurable tasks score zero in the source. Source effort metadata is preserved. Inspect source ↗Attributed public leaderboard score facts · LiveBench | max / LiveBench 2 · 20261025 | LiveBench ↗ |
|---|
| LiveBench 2 Long Agentic · 20261025Agents | 26.40%kimi-k3 · max · LiveBench 2 20261025 LiveBench · independent-run Run: Date not supplied · 20261025/table.csv Benchmark edition 25 October 2026; individual run date not supplied. One run per model; mean task score. Failed/unmeasurable tasks score zero in the source. Source effort metadata is preserved. Inspect source ↗Attributed public leaderboard score facts · LiveBench | max / LiveBench 2 · 20261025 | LiveBench ↗ |
|---|