Moonshot AI•Rank #12

Kimi K3

Open Weights • Open Sourcegeneralreasoningcodingagentopen-source
Leaderboard Score
56.0
Scale: 0 - 100
Throughput Speed
52 tps
Context Window
1M
API Pricing / 1M
Free/Open Source
Parameter Scale
2.8T
Verified AI Radar & Benchmarks•9 Evaluated Metrics

Capability Radar & Benchmark Scores

Multi-Axis Capability Radar

Comparing Kimi K3 against Frontier Top 10 & Open-Source average

0 - 100 Scale
Kimi K3
Frontier Top 10 Avg
Open-Source Avg
Performance Vectors

Where Kimi K3 Leads

Coding & SWETop 10: 79.1% • OS: 47.6%
80.5%+1.4% vs Top 10
Reasoning & MathTop 10: 74.6% • OS: 46.6%
64.2%-10.4% vs Top 10
Agent & Tool AutomationTop 10: 71.2% • OS: 31.9%
56.4%-14.8% vs Top 10
Terminal & CLI ExecutionTop 10: 80.4% • OS: 47.6%
85.7%+5.3% vs Top 10
MMLU & Knowledge QATop 10: 50% • OS: 86.7%
70.0%+20.0% vs Top 10
Cyber & Security ExploitsTop 10: 87.8% • OS: 80.6%
80.0%-7.8% vs Top 10

All Verified Benchmark Evaluations

Direct Pass@1 and resolution rates across standardized evaluations.

OverallCodingReasoningAgenticTerminalSecurity
Featured Compute Platform

Run Benchmarks on Dedicated AI Clusters

Zero-cold-start inference endpoints with dedicated GPU instances.

Compare With Alternatives →

Executive Analysis & Verdict

Kimi K3 by Moonshot AI is an open source Large Language Model ranking #5 globally with an overall benchmark score of 56.0 and 1682 GDPVal-AA Elo.

Key Strengths & Highlights

  • •Robust coding accuracy on DeepSWE (67.5) and Terminal Bench 2.1 (85.7)
  • •Strong reasoning on HLE w/ Tools (59.8) and AutomationBench (46.7)
  • •Proven cybersecurity performance on CyberGym (80.0) with 1.0M token context

Limitations & Considerations

  • •Requires high VRAM infrastructure for local 2.8T MoE serving
Recommended Workflows
Open-weights coding assistants, agentic terminal orchestration, and mathematical problem-solving

The Best Open-Weights Model Nobody Priced This Well

Start with the combination, because it is unprecedented in our dataset: Kimi K3 is the highest-overall open-weights model we track (56.0), it scores 85.7 on Terminal-Bench - better than DeepSeek’s flagship and second only to the closed frontier pair - and it costs $4.33 per million tokens with a 1M context window. Moonshot AI has positioned K3 exactly where developer demand is: agentic coding quality near the closed frontier, at a price that survives high-volume production use.

Benchmark Deep Dive, In Plain English

  • Terminal-Bench 85.7 - The live-terminal evaluation: clone the repo, reproduce the bug, fix it, make the tests pass, leave the environment working. K3’s 85.7 puts it in the same conversation as Claude Fable 5 (88.0) while costing 3.3 times less per token. If your coding agent spends its day in a shell, this is the budget pick that does not feel like one.
  • GPQA 64.2 and MATH-500 59.8 - Graduate-level science reasoning and competition math. K3 sits between DeepSeek-V4-Pro (weaker math) and GPT-5.6 Sol (stronger) - a genuine mid-tier in reasoning, not a coding specialist pretending to be general.
  • BrowseComp 46.7 - Web-research tasks, marginally ahead of Sol’s 45.8. Combined with the 1M context window, K3 handles long research-and-synthesis chains respectably.

When to Choose K3

Choose K3 when you need near-frontier agentic coding at a price that scales: startup products, agent fleets, CI pipelines that review every pull request. It is the strongest open-weights option for teams that want self-hosting rights without giving up Terminal-Bench performance - the exact gap between K3 and DeepSeek-V4-Pro-0813 is terminal proficiency, and it is large (85.7 vs 80.3). If your work is math-heavy instead, check GPT-5.6 Sol or compare the two directly on the comparison engine.

Pricing Reality Check

$4.33 flat per million tokens puts the standard 10,000-request workload (15K tokens average) at about $650 - roughly 30% of Claude Fable 5’s bill for the same volume, with 80.5 vs 84.5 SWE-bench as the quality trade. For teams running continuous background agents (code review, triage, documentation sync), that difference decides whether the project gets budget approval at all.

Real Limitations

Peak capability is not the frontier: on the hardest reasoning and the most novel debugging, Fable 5 and GPT-5.6 Sol still pull away, and K3’s arena Elo (1682) sits below both. Throughput is 77 tokens per second - slower than DeepSeek’s 176, which matters for long generation loops. And open-weights operations apply: self-hosting means GPU capacity planning, and the API tier carries the usual provider rate limits at scale.

Where to Go Next

Frequently Asked Questions About Kimi K3

What is Kimi K3 and who developed it?↓
Kimi K3 is a open source large language model developed by Moonshot AI. It ranks #12 on the RankLLMs composite leaderboard, ahead of 87% of the 85 models we track, with an overall score of 56.0 / 100.
Can Kimi K3 handle very long documents and codebases?↓
Kimi K3 supports a 1.0M-token input context window and generates about 52 tps tokens per second in our reference measurements and which is enough to hold entire repositories, long transcripts, or multi-document research sets in a single session..
Can I self-host Kimi K3?↓
Yes. Kimi K3 is released with Open Source licensing, so it can be self-hosted on private infrastructure with no per-token API cost. Check the specifications above for the memory footprint and quantization headroom to plan your hardware.
What is Kimi K3 best at?↓
Kimi K3 is strongest in Robust coding accuracy on DeepSWE (67.5) and Terminal Bench 2.1 (85.7); Strong reasoning on HLE w/ Tools (59.8) and AutomationBench (46.7); Proven cybersecurity performance on CyberGym (80.0) with 1.0M token context. Full pillar-by-pillar numbers are in the benchmark tables above.
What should you watch out for with Kimi K3?↓
Known trade-offs include: Requires high VRAM infrastructure for local 2.8T MoE serving. Weigh these against the strengths above for your specific workload.