xAI•Rank #58UNRELEASED

Grok-4 Heavy

Proprietarygeneral
Leaderboard Score
41.0
Scale: 0 - 100
Throughput Speed
75 tps
Context Window
1M
API Pricing / 1M
$3.00
Parameter Scale
Proprietary
Verified AI Radar & Benchmarks•5 Evaluated Metrics

Capability Radar & Benchmark Scores

Multi-Axis Capability Radar

Comparing Grok-4 Heavy against Frontier Top 10 & Open-Source average

0 - 100 Scale
Grok-4 Heavy
Frontier Top 10 Avg
Open-Source Avg
Performance Vectors

Where Grok-4 Heavy Leads

Coding & SWETop 10: 79.1% • OS: 47.6%
17.7%-61.4% vs Top 10
Reasoning & MathTop 10: 74.6% • OS: 46.6%
39.3%-35.3% vs Top 10
Agent & Tool AutomationTop 10: 71.2% • OS: 31.9%
45.1%-26.1% vs Top 10
Terminal & CLI ExecutionTop 10: 80.4% • OS: 47.6%
17.7%-62.7% vs Top 10
MMLU & Knowledge QATop 10: 50% • OS: 86.7%
51.3%+1.3% vs Top 10
Cyber & Security ExploitsTop 10: 87.8% • OS: 80.6%
38.9%-48.9% vs Top 10

All Verified Benchmark Evaluations

Direct Pass@1 and resolution rates across standardized evaluations.

OverallCodingReasoningTerminal
Featured Compute Platform

Run Benchmarks on Dedicated AI Clusters

Zero-cold-start inference endpoints with dedicated GPU instances.

Compare With Alternatives →

Executive Analysis & Verdict

Grok-4 Heavy by xAI is a proprietary Large Language Model ranking #45 globally with an overall benchmark score of 41.

Key Strengths & Highlights

  • •High overall benchmark score of 41 on frontier evaluation suites
  • •Robust reasoning performance (39.3) and coding accuracy (17.7)
  • •Optimized inference throughput with extended token context

Limitations & Considerations

  • •Subject to standard provider rate limits and API quota
Recommended Workflows
Enterprise production applications, coding assistance, and advanced reasoning

Architectural Overview & Capability Profile

Grok-4 Heavy is developed by xAI as an advanced foundation model engineered for production enterprise applications, reasoning workflows, and autonomous problem-solving. On the comprehensive RankLLMs composite evaluation index, Grok-4 Heavy registers an overall benchmark rating of 41.0 / 100.

Operating under a Proprietary license structure, Grok-4 Heavy is served via high-throughput managed API endpoints designed for low-latency production queries.

Benchmark Performance & Real-World Utility

In standardized laboratory and real-world evaluation suites, Grok-4 Heavy demonstrates calibrated proficiency across key performance vectors:

  • SWE-bench Verified Software Engineering (17.7%): Measures multi-file GitHub issue resolution. The model demonstrates practical capability in localizing source code bugs, synthesizing functional patches, and passing rigorous integration test matrices. For evaluation methodology, consult our SWE-bench Pro guide.

  • GPQA Diamond Scientific Reasoning (39.3%): Assesses graduate-level domain problem solving across physics, chemistry, and biology, minimizing hallucinations in multi-step deductive arguments. See our Humanity’s Last Exam benchmark analysis.

  • MATH-500 Competition Mathematics (39.3%): Evaluates formal mathematical problem solving and symbolic derivation, providing foundational logic for algorithmic computing.

  • Terminal-Bench Execution (17.7%): Reflects proficiency in interactive command-line environments, shell tool use, and automated DevOps scripting.

Inference Latency & Cost Architecture

  • Token Context Window: 1.0M tokens, allowing large documents, multi-file codebases, and long conversation memories to be processed in a single context window.
  • Inference Speed: Reference throughput clocks at approximately 75 tokens/second, enabling responsive streaming in developer tools and interactive interfaces.
  • Commercial Pricing: API consumption is billed at $3.00 per 1M input tokens and $15.00 per 1M output tokens, offering predictable scaling for high-volume enterprise traffic.

Strengths, Limitations & Ideal Workflows

Primary Strengths

  • High overall benchmark score of 41 on frontier evaluation suites
  • Robust reasoning performance (39.3) and coding accuracy (17.7)
  • Optimized inference throughput with extended token context

Known Considerations

  • Subject to standard provider rate limits and API quota

Enterprise production applications, coding assistance, and advanced reasoning.

Frequently Asked Questions About Grok-4 Heavy

What is Grok-4 Heavy and who developed it?↓
Grok-4 Heavy is a proprietary large language model developed by xAI. It ranks #58 on the RankLLMs composite leaderboard, ahead of 33% of the 85 models we track, with an overall score of 41.0 / 100.
Can Grok-4 Heavy handle very long documents and codebases?↓
Grok-4 Heavy supports a 1.0M-token input context window and generates about 75 tps tokens per second in our reference measurements and which is enough to hold entire repositories, long transcripts, or multi-document research sets in a single session..
Why does Grok-4 Heavy cost more than most alternatives?↓
Grok-4 Heavy sits in the premium tier at $3.00 per 1M tokens - cheaper than only 85% of priced models we track. That pricing buys frontier-tier benchmark results; the cost-per-solved-task math in our best-coding-LLM guide shows when it pays off.
What is Grok-4 Heavy best at?↓
Grok-4 Heavy is strongest in High overall benchmark score of 41 on frontier evaluation suites; Robust reasoning performance (39.3) and coding accuracy (17.7); Optimized inference throughput with extended token context. Full pillar-by-pillar numbers are in the benchmark tables above.
What should you watch out for with Grok-4 Heavy?↓
Known trade-offs include: Subject to standard provider rate limits and API quota. Weigh these against the strengths above for your specific workload.