Skip to main content
Local Engine Ready

Qwen3 235B-A22B

1 consumer GPUs can run Qwen3 235B-A22B at Q4 natively. Precise VRAM thresholds and benchmarks below.

1 Compatible GPUs
1 with offloading
235B params
131K context
Javier Morales
Javier Morales AI Hardware Specialist — 8 years experience
GitHub: github.com/javier-morales-ia

llama.cpp 0.2.x · CUDA 12 · ROCm 6 · Updated monthly · methodology →

Execution Context

ARCHITECTURE TRANSFORMER
CONTEXT 131K TOKENS
QUANTIZATION 4-BIT GGUF
PROVIDER Alibaba
LICENSE Apache 2.0
VRAM REQUIREMENT
129.3 GB
4GB 8GB 12GB 16GB 24GB+
Hardware Decision

This model requires a Flagship GPU (48 GB+ VRAM)

Minimum

M3 Ultra

Runs at Q4 — functional, some wait

192 GB VRAM
View compatible setup
Balanced

M4 Ultra

Best value for daily use

128 GB VRAM offload
View compatible setup
Optimal

M3 Ultra

Full quality, fastest inference

192 GB VRAM
View compatible setup

*Prices and availability may change. Some links are affiliate links.

System Requirements

GPU VRAM 129.3 GB High-end GPU
System RAM 194 GB 64 GB or more
Storage 117.5 GB Q4 · SSD recommended
CPU Any modern CPU GPU required

VRAM by Quantization

Quantization VRAM needed Disk space Quality
FP16 (max quality) 517 GB 470 GB Maximum
Q8 (high quality) 258.5 GB 235 GB Near-lossless
Q4 (recommended) Best balance 129.3 GB 117.5 GB Recommended
Q2 (minimum) 64.6 GB 58.8 GB Quality loss

Model Details

Developer Alibaba
Parameters 235B
Context window 131,072 tokens
License Apache 2.0
Use cases chat, reasoning, coding, analysis
Released 2025-04

Install with Ollama

ollama run qwen3:235b-a22b

Hugging Face

Qwen/Qwen3-235B-A22B
View on HF →
Technical Requirements

Can your GPU run Qwen3 235B-A22B?

Qwen3 235B-A22B requires 129.3 GB VRAM at Q4. 1 consumer GPUs meet this threshold. Below 8 GB or 127.30000000000001 GB you'll hit significant offload latency.

64.6GB Critical min
129.3GB Optimal Q4
258.5GB High Quality Q8
517GB Max FP16

Hardware Performance Matrix

1 Q4 native · 1 offload · 38 unsupported

GPU Unit VRAM Compatibility Est. Speed Action
M3 Ultra 192GB Optimal 38 tok/s Calculate →
M4 Ultra 128GB Offload 45 tok/s Calculate →
RTX 5090 32GB N/A Calculate →
RTX 4090 24GB N/A Calculate →
RTX 5080 16GB N/A Calculate →
RTX 4080 Super 16GB N/A Calculate →
RTX 5070 Ti 16GB N/A Calculate →
RTX 3090 24GB N/A Calculate →
M4 Max 48GB 48GB N/A 20 tok/s Calculate →
RX 7900 XTX 24GB N/A Calculate →
M4 Max 36GB 36GB N/A Calculate →
RTX 4070 Ti Super 16GB N/A Calculate →
RTX 3080 Ti 12GB N/A Calculate →
RX 7900 XT 20GB N/A Calculate →
RTX 5070 12GB N/A Calculate →
RTX 3080 10GB N/A Calculate →
M4 Pro 24GB N/A Calculate →
RX 7800 XT 16GB N/A Calculate →
RX 6800 XT 16GB N/A Calculate →
RTX 4070 12GB N/A Calculate →
RTX 4060 Ti 16GB 16GB N/A Calculate →
RX 7700 XT 12GB N/A Calculate →
RTX 3070 Ti 8GB N/A Calculate →
RTX 4060 Ti 8GB N/A Calculate →
RTX 3070 8GB N/A Calculate →
RX 6700 XT 12GB N/A Calculate →
M3 Pro 18GB N/A Calculate →
RTX 3060 Ti 8GB N/A Calculate →
RTX 2080 Ti 11GB N/A Calculate →
RTX 3060 12GB N/A Calculate →
M2 Pro 16GB N/A Calculate →
RTX 4060 8GB N/A Calculate →
Arc A770 16GB 16GB N/A Calculate →
M1 Pro 16GB N/A Calculate →
RX 7600 8GB N/A Calculate →
RX 6600 XT 8GB N/A Calculate →
Arc A750 8GB 8GB N/A Calculate →
RX 6600 8GB N/A Calculate →
RTX 3050 8GB 8GB N/A Calculate →
GTX 1660 Super 6GB N/A Calculate →

Recommended GPUs for Qwen3 235B-A22B

Benchmarks Reales
Sin Reviews Pagadas
Seleccion Editorial
Basado en Datos

Best picks by compatibility, VRAM headroom, and value — prices and availability may change.

Some links are Amazon affiliate links. We may earn a commission at no extra cost to you. Amazon cookies may last up to 24 hours after your click.

Qwen3 235B-A22B — Compatibility guide

Qwen3 235B-A22B with 235B parameters only runs fully in multi-GPU or server configurations. Consider distilled versions if available. The VRAM calculator can help you find compatible alternatives.

Compatible Hardware

GPUs that run Qwen3 235B-A22B at Q4 — sorted by AI performance score.

Benchmarks Reales
Sin Reviews Pagadas
Basado en Datos
M3 Ultra

Apple · 192 GB VRAM

Q4 OK
38 tok/s > $1000

Some links are Amazon affiliate links. We may earn a commission at no extra cost to you. Amazon cookies may last up to 24 hours after your click.

More Practical Alternatives

Similar models in the chat category with comparable VRAM footprints.

Not sure which GPU you need for Qwen3 235B-A22B?

The VRAM Calculator tells you exactly which quantization your hardware can handle.