Can I Run / Qwen 3 Next 80B A3B / on Apple M2 Ultra (64GB)

Can I Run Qwen 3 Next 80B A3B on a Apple M2 Ultra (64GB)?

Yes

Runs at Q5_K_M — good quality with reasonable headroom.

Model size
80.0B
GPU memory
64.0GB
Smallest quant
Q2_K
Best fit
Q5_K_M

11 quantizations fit your 64.0GB

QuantMin VRAMRecommendedFile sizeHeadroom
Q5_K_MBEST57.8 GB59.3 GB56.7 GB+6.2 GB
Q5_K_S56.2 GB57.7 GB55.0 GB+7.8 GB
Q5_056.0 GB57.5 GB55.0 GB+8.0 GB
Q4_151.0 GB52.5 GB50.0 GB+13.0 GB
Q4_K_M49.5 GB51.0 GB48.7 GB+14.5 GB
Q4_K_S46.8 GB48.3 GB46.9 GB+17.2 GB
Q4_046.0 GB47.5 GB46.1 GB+18.0 GB
Q3_K_L36.6 GB38.1 GB38.2 GB+27.4 GB
Q3_K_M34.5 GB36.0 GB36.7 GB+29.5 GB
Q3_K_S31.8 GB33.3 GB34.9 GB+32.2 GB
Q2_K27.3 GB28.8 GB28.2 GB+36.7 GB

Try it in the cloud first

Don't want to download Qwen 3 Next 80B A3B just to try it? Use a hosted API or rent a GPU by the second.

Affiliate links — we earn a commission at no cost to you.

Advertisement
Full model details
Qwen 3 Next 80B A3B

All quant variants, benchmark scores, and use-case tags.

Best models for this GPU
Apple M2 Ultra (64GB)

Top-ranked open-source models that fit in 64.0GB.

FAQ

Can the Apple M2 Ultra (64GB) run Qwen 3 Next 80B A3B?

Yes. The Apple M2 Ultra (64GB)'s 64.0GB of unified memory is enough to run Qwen 3 Next 80B A3B at Q5_K_M quantization (57.8GB required).

What's the best quantization to use?

Q5_K_M is the highest-precision quantization that fits in your 64.0GB. It uses about 57.8GB of memory and 59.3GB recommended for comfortable inference.

What if I need more headroom for context length?

KV cache memory grows with context length. The numbers above assume a baseline 2K-4K context. For long-context use (32K+), add another 2-6GB depending on the model architecture.