Qwen / Alibaba•Rank #65

Qwen3.5-397B-A17B

Open Weights • Open Sourcegeneralopen-source
Leaderboard Score
39.2
Scale: 0 - 100
Throughput Speed
50 tps
Context Window
262K
API Pricing / 1M
Free/Open Source
Parameter Scale
397B
Verified AI Radar & Benchmarks•8 Evaluated Metrics

Capability Radar & Benchmark Scores

Multi-Axis Capability Radar

Comparing Qwen3.5-397B-A17B against Frontier Top 10 & Open-Source average

0 - 100 Scale
Qwen3.5-397B-A17B
Frontier Top 10 Avg
Open-Source Avg
Performance Vectors

Where Qwen3.5-397B-A17B Leads

Coding & SWETop 10: 79.1% • OS: 47.6%
23.4%-55.7% vs Top 10
Reasoning & MathTop 10: 74.6% • OS: 46.6%
39.0%-35.6% vs Top 10
Agent & Tool AutomationTop 10: 71.2% • OS: 31.9%
21.0%-50.2% vs Top 10
Terminal & CLI ExecutionTop 10: 80.4% • OS: 47.6%
23.4%-57.0% vs Top 10
MMLU & Knowledge QATop 10: 50% • OS: 86.7%
49.0%-1.0% vs Top 10
Cyber & Security ExploitsTop 10: 87.8% • OS: 80.6%
37.2%-50.6% vs Top 10

All Verified Benchmark Evaluations

Direct Pass@1 and resolution rates across standardized evaluations.

OverallCodingReasoningAgenticTerminal
Featured Compute Platform

Run Benchmarks on Dedicated AI Clusters

Zero-cold-start inference endpoints with dedicated GPU instances.

Compare With Alternatives →

Executive Analysis & Verdict

Qwen3.5-397B-A17B by Alibaba Cloud / Qwen Team is a open source Large Language Model ranking #54 globally with an overall benchmark score of 39.2.

Key Strengths & Highlights

  • •High overall benchmark score of 39.2 on frontier evaluation suites
  • •Robust reasoning performance (39) and coding accuracy (23.4)
  • •Optimized inference throughput with extended token context

Limitations & Considerations

  • •Requires high VRAM infrastructure for local multi-GPU deployment
Recommended Workflows
Self-hosted inference, private data deployment, and custom fine-tuning

Architectural Overview & Capability Profile

Qwen3.5-397B-A17B is developed by Qwen as an advanced foundation model engineered for production enterprise applications, reasoning workflows, and autonomous problem-solving. On the comprehensive RankLLMs composite evaluation index, Qwen3.5-397B-A17B registers an overall benchmark rating of 39.2 / 100.

Operating under a Open Weights license structure, Qwen3.5-397B-A17B is distributed as an open-weights architecture capable of local deployment, private VPC inference, and custom fine-tuning.

Benchmark Performance & Real-World Utility

In standardized laboratory and real-world evaluation suites, Qwen3.5-397B-A17B demonstrates calibrated proficiency across key performance vectors:

  • SWE-bench Verified Software Engineering (23.4%): Measures multi-file GitHub issue resolution. The model demonstrates practical capability in localizing source code bugs, synthesizing functional patches, and passing rigorous integration test matrices. For evaluation methodology, consult our SWE-bench Pro guide.

  • GPQA Diamond Scientific Reasoning (39%): Assesses graduate-level domain problem solving across physics, chemistry, and biology, minimizing hallucinations in multi-step deductive arguments. See our Humanity’s Last Exam benchmark analysis.

  • MATH-500 Competition Mathematics (39%): Evaluates formal mathematical problem solving and symbolic derivation, providing foundational logic for algorithmic computing.

  • Terminal-Bench Execution (23.4%): Reflects proficiency in interactive command-line environments, shell tool use, and automated DevOps scripting.

  • Code Arena Preference Rating (1296 Elo): Validates human developer satisfaction in blind side-by-side coding evaluations against contemporary alternatives.

Inference Latency & Cost Architecture

  • Token Context Window: 262K tokens, allowing large documents, multi-file codebases, and long conversation memories to be processed in a single context window.
  • Inference Speed: Reference throughput clocks at approximately 50 tokens/second, enabling responsive streaming in developer tools and interactive interfaces.
  • Commercial Pricing: Zero per-token inference fee when self-hosted on owned GPU infrastructure (e.g. vLLM or Ollama), with marginal costs limited strictly to hardware compute.

Strengths, Limitations & Ideal Workflows

Primary Strengths

  • High overall benchmark score of 39.2 on frontier evaluation suites
  • Robust reasoning performance (39) and coding accuracy (23.4)
  • Optimized inference throughput with extended token context

Known Considerations

  • Requires high VRAM infrastructure for local multi-GPU deployment

Self-hosted inference, private data deployment, and custom fine-tuning.

Frequently Asked Questions About Qwen3.5-397B-A17B

What is Qwen3.5-397B-A17B and who developed it?↓
Qwen3.5-397B-A17B is a open source large language model developed by Qwen / Alibaba. It ranks #65 on the RankLLMs composite leaderboard, ahead of 25% of the 85 models we track, with an overall score of 39.2 / 100.
What context window and inference speed does Qwen3.5-397B-A17B offer?↓
Qwen3.5-397B-A17B supports a 262K-token input context window and generates about 50 tps tokens per second in our reference measurements and suitable for extended reasoning sessions and multi-turn agent workflows..
Can I self-host Qwen3.5-397B-A17B?↓
Yes. Qwen3.5-397B-A17B is released with Open Source licensing, so it can be self-hosted on private infrastructure with no per-token API cost. Check the specifications above for the memory footprint and quantization headroom to plan your hardware.
What is Qwen3.5-397B-A17B best at?↓
Qwen3.5-397B-A17B is strongest in High overall benchmark score of 39.2 on frontier evaluation suites; Robust reasoning performance (39) and coding accuracy (23.4); Optimized inference throughput with extended token context. Full pillar-by-pillar numbers are in the benchmark tables above.
What should you watch out for with Qwen3.5-397B-A17B?↓
Known trade-offs include: Requires high VRAM infrastructure for local multi-GPU deployment. Weigh these against the strengths above for your specific workload.