Inkling-Small

Architectural Overview & Capability Profile

Inkling-Small is developed by Thinking-machines as an advanced foundation model engineered for production enterprise applications, reasoning workflows, and autonomous problem-solving. On the comprehensive RankLLMs composite evaluation index, Inkling-Small registers an overall benchmark rating of 39.3 / 100.

Operating under a Open Weights license structure, Inkling-Small is distributed as an open-weights architecture capable of local deployment, private VPC inference, and custom fine-tuning.

Benchmark Performance & Real-World Utility

In standardized laboratory and real-world evaluation suites, Inkling-Small demonstrates calibrated proficiency across key performance vectors:

• SWE-bench Verified Software Engineering (31.1%): Measures multi-file GitHub issue resolution. The model demonstrates practical capability in localizing source code bugs, synthesizing functional patches, and passing rigorous integration test matrices. For evaluation methodology, consult our SWE-bench Pro guide.

• GPQA Diamond Scientific Reasoning (39%): Assesses graduate-level domain problem solving across physics, chemistry, and biology, minimizing hallucinations in multi-step deductive arguments. See our Humanity’s Last Exam benchmark analysis.

• MATH-500 Competition Mathematics (39%): Evaluates formal mathematical problem solving and symbolic derivation, providing foundational logic for algorithmic computing.

• Terminal-Bench Execution (31.1%): Reflects proficiency in interactive command-line environments, shell tool use, and automated DevOps scripting.

Inference Latency & Cost Architecture

• Token Context Window: 524K tokens, allowing large documents, multi-file codebases, and long conversation memories to be processed in a single context window.
• Inference Speed: Reference throughput clocks at approximately 50 tokens/second, enabling responsive streaming in developer tools and interactive interfaces.
• Commercial Pricing: Zero per-token inference fee when self-hosted on owned GPU infrastructure (e.g. vLLM or Ollama), with marginal costs limited strictly to hardware compute.

Strengths, Limitations & Ideal Workflows

Primary Strengths

• High overall benchmark score of 39.3 on frontier evaluation suites
• Robust reasoning performance (39) and coding accuracy (31.1)
• Optimized inference throughput with 256K token context

Known Considerations

• Requires high VRAM infrastructure for local multi-GPU deployment

Recommended Use Cases

Self-hosted inference, private data deployment, and custom fine-tuning.

Related Comparisons & Leaderboard Context

• Compare with alternatives in the Model Comparison Engine
• Compare global rankings on the AI Model Leaderboard
• View complete platform index in our HTML Sitemap & Directory
• Explore top coding models in our Best LLM for Coding Guide