How much VRAM does Qwen3 235B-A22B need?

Qwen3 235B-A22B requires 129.3 GB VRAM to run at Q4 quantization (recommended), 258.5 GB for Q8, and 517 GB for full FP16 precision. The minimum is 64.6 GB at Q2 with some quality loss.

What GPU do I need for Qwen3 235B-A22B?

You need at least 129.3 GB VRAM to run Qwen3 235B-A22B at Q4 quantization. 1 consumer GPUs are compatible. The most popular choice is an NVIDIA RTX-class GPU with 129.3+ GB VRAM.

Is Qwen3 235B-A22B free to use?

Qwen3 235B-A22B by Alibaba is available under the Apache 2.0 license. Check the license terms for commercial use restrictions. You can download and run it for free with Ollama: ollama run qwen3:235b-a22b

Local Engine Ready

Qwen3 235B-A22B

Name: Qwen3 235B-A22B
Author: Javier Morales

1 consumer GPUs can run Qwen3 235B-A22B at Q4 natively. Precise VRAM thresholds and benchmarks below.

1 Compatible GPUs

1 with offloading

235B params

131K context

Top pick

M3 Ultra · 192 GB VRAM runs Q4 natively

Check availability See top 3 ↓

Prices and availability may change · affiliate link

Javier Morales AI hardware specialist — 8 years of experience Aktualisiert 2026-04-08

GitHub: github.com/javier-morales-ia

llama.cpp 0.2.x · CUDA 12 · ROCm 6 · updated monthly · methodology →

Execution Context

ARCHITECTURE TRANSFORMER

CONTEXT 131K TOKENS

QUANTIZATION 4-BIT GGUF

PROVIDER Alibaba

LICENSE Apache 2.0

VRAM REQUIREMENT

129.3 GB

4GB 8GB 12GB 16GB 24GB+

Hardware Decision

This model requires aFlagship GPU (48 GB+ VRAM)

Minimum

M3 Ultra

Runs at Q4 — functional, some wait

192 GB VRAM

View compatible setup

Balanced

M4 Ultra

Best value for daily use

128 GB VRAM offload

View compatible setup

Optimal

M3 Ultra

Full quality, fastest inference

192 GB VRAM

View compatible setup

Compatible GPUs for Qwen3 235B-A22B

Best picks by compatibility, VRAM headroom, and value — prices and availability may change.

192 GB VRAM · Q4 native Amazon

M3 Ultra

0.0 (0 Bewertungen)

Vorteile

Runs Qwen3 235B-A22B at Q4 natively
192 GB VRAM — adequate headroom

M3 Ultra auf Amazon ansehen →

128 GB VRAM · Offloading Amazon

M4 Ultra

0.0 (0 Bewertungen)

Vorteile

Works via CPU offloading
128 GB VRAM — adequate headroom

Einige Links sind Amazon-Partnerlinks. Wir koennen ohne Mehrkosten fuer Sie eine Provision erhalten. Amazon-Cookies koennen nach Ihrem Klick bis zu 24 Stunden bestehen.

How to run this model

Check if your GPU can run Qwen3 235B-A22B →

VRAM Calculator — instant compatibility check

M3 Ultra

192 GB · Runs Q4 natively · Check availability

*Prices and availability may change. Some links are affiliate links.

System Requirements

GPU VRAM 129.3 GB High-end GPU

System RAM 194 GB 64 GB or more

Storage 117.5 GB Q4 · SSD recommended

CPU Any modern CPU GPU required

VRAM by Quantization

Quantization	VRAM needed	Disk space	Quality
FP16 (max quality)	517 GB	470 GB	Maximum
Q8 (high quality)	258.5 GB	235 GB	Near-lossless
Q4 (recommended) Best balance	129.3 GB	117.5 GB	Recommended
Q2 (minimum)	64.6 GB	58.8 GB	Quality loss

Model Details

Developer	Alibaba
Parameters	235B
Context window	131,072 tokens
License	Apache 2.0
Use cases	chat, reasoning, coding, analysis
Released	2025-04

Install with Ollama

ollama run qwen3:235b-a22b

Hugging Face

Qwen/Qwen3-235B-A22B

View on HF →

Technical Requirements

Can your GPU run Qwen3 235B-A22B?

Qwen3 235B-A22B requires <strong class="text-primary-container">129.3 GB VRAM</strong> at Q4. 1 consumer GPUs meet this threshold. Below 8 GB or 127.30000000000001 GB you'll hit significant offload latency.

M3 Ultra (192 GB)

64.6GB Critical min

129.3GB Optimal Q4

258.5GB High Quality Q8

517GB Max FP16

Hardware Performance Matrix

1 Q4 native · 1 offload

GPU Unit	VRAM	Compatibility	Est. Speed	Action
M3 Ultra	192GB	Optimal	38 tok/s	Calculate →
M4 Ultra	128GB	Offload	45 tok/s	Calculate →

Recommended GPUs for Qwen3 235B-A22B

Reale Benchmarks

Keine bezahlten Reviews

Redaktionelle Auswahl

Datenbasiert

Best picks by compatibility, VRAM headroom, and value — prices and availability may change.

M3 Ultra

192 GB VRAM

Q4 native

Check availability →

M4 Ultra

128 GB VRAM

Offloading

Check availability →

Einige Links sind Amazon-Partnerlinks. Wir koennen ohne Mehrkosten fuer Sie eine Provision erhalten. Amazon-Cookies koennen nach Ihrem Klick bis zu 24 Stunden bestehen.

Qwen3 235B-A22B — Compatibility guide

Qwen3 235B-A22B with 235B parameters only runs fully in multi-GPU or server configurations. Consider distilled versions if available. The VRAM calculator can help you find compatible alternatives.

Compatible Hardware

GPUs that run Qwen3 235B-A22B at Q4 — sorted by AI performance score.

Reale Benchmarks

Keine bezahlten Reviews

Datenbasiert

M3 Ultra

Apple · 192 GB VRAM

Q4 OK

38 tok/s > $1000

View analysis View on Amazon →

Einige Links sind Amazon-Partnerlinks. Wir koennen ohne Mehrkosten fuer Sie eine Provision erhalten. Amazon-Cookies koennen nach Ihrem Klick bis zu 24 Stunden bestehen.

More Practical Alternatives

Similar models in the chat category with comparable VRAM footprints.

Mistral Small 4

119B params • 65.5GB VRAM

Mistral AI • Apache 2.0

Command R+

104B params • 59GB VRAM

Cohere • CC-BY-NC-4.0

Qwen2.5 72B

72B params • 41GB VRAM

Alibaba • Apache-2.0

Llama 3.1 70B

70B params • 40GB VRAM

Meta • llama-3.1-community

Not sure which GPU you need for Qwen3 235B-A22B?

The VRAM Calculator tells you exactly which quantization your hardware can handle.

Open Calculator Full Hardware Wizard