GPU GUIDE · APPLE
Best AI models for the
Apple M5 Ultra (512GB)
The Apple M5 Ultra (512GB) has 512GB of unified memory. Below are the top 30 open-source AI models that fit, ranked by composite benchmark score. Each row shows the best quantization that fits your hardware.
VRAM
512GB
Brand
apple
Models that fit
30
Generation
M5
Top 30 models for the Apple M5 Ultra (512GB)
01
77.9Qwen3.8 2.4T A95B
95.0BBest fit: fp16 · 191.0GBCan I run it? →
02
69.0Qwen3.8 27B
27.0BBest fit: fp16 · 55.0GBCan I run it? →
03
67.8DeepSeek V4 Flash
291BBest fit: Q8_0 · 310.1GBCan I run it? →
04
60.0NVIDIA Nemotron 3 Super
340BBest fit: Q8_0 · 362.3GBCan I run it? →
05
54.8Qwen 3.6 Max
480BBest fit: Q8_0 · 511.0GBCan I run it? →
06
54.3MiMo V2.5 Pro
320BBest fit: Q8_0 · 341.0GBCan I run it? →
07
54.0GLM-5
230BBest fit: fp16 · 461.0GBCan I run it? →
08
52.5Qwen 3.6 Plus
235BBest fit: fp16 · 471.0GBCan I run it? →
09
50.1MiniMax M2.7
456BBest fit: Q8_0 · 485.5GBCan I run it? →
10
49.1MiMo V2 Omni
120BBest fit: fp16 · 241.0GBCan I run it? →
11
48.9Nemotron 3 Ultra
550BBest fit: Q6_K · 454.1GBCan I run it? →
12
48.3Qwen 3.6 27B
27.8BBest fit: f32 · 112.2GBCan I run it? →
13
46.7Qwen 3 Coder
480BBest fit: Q8_0 · 511.0GBCan I run it? →
14
45.0Qwen 3 Next 80B A3B
80.0BBest fit: Q8_0 · 86.0GBCan I run it? →
15
44.9Qwen3.5-27B
27.0BBest fit: fp16 · 55.0GBCan I run it? →
16
43.7Qwen 3.6 35B A3B
36.0BBest fit: f32 · 145.0GBCan I run it? →
17
42.2DeepSeek V3.2
685BBest fit: Q5_K_M · 487.6GBCan I run it? →
18
41.4Qwen 3.5 122B A10B
125BBest fit: f32 · 501.4GBCan I run it? →
19
40.6Muse Glimmer 30B
30.0BBest fit: fp16 · 61.0GBCan I run it? →
20
39.9Qwen 3.5 Omni Plus
235BBest fit: fp16 · 471.0GBCan I run it? →
21
37.8Mistral Medium 3.5 128B
128BBest fit: f32 · 511.8GBCan I run it? →
22
37.7Qwen 3.5 35B A3B
36.0BBest fit: f32 · 145.0GBCan I run it? →
23
37.0Gemma 4 31B
31.3BBest fit: f32 · 126.2GBCan I run it? →
24
36.7Devstral 2
24.0BBest fit: f32 · 97.0GBCan I run it? →
25
31.9Gemma 4 26B A4B
26.0BBest fit: fp16 · 53.0GBCan I run it? →
26
31.7Devstral Small 2
7.0BBest fit: f32 · 29.0GBCan I run it? →
27
31.1NVIDIA Nemotron 3 Super 120B A12B BF16
124BBest fit: fp16 · 248.2GBCan I run it? →
28
28.3Llama 3.1 405B Instruct
406BBest fit: Q8_0 · 432.3GBCan I run it? →
29
26.7Ministral 3 14B
14.0BBest fit: f32 · 57.0GBCan I run it? →
30
26.0GPT-OSS 120B
120BBest fit: fp16 · 241.0GBCan I run it? →
Advertisement
FAQ — running AI on the Apple M5 Ultra (512GB)
How many AI models can the Apple M5 Ultra (512GB) run?
With 512GB of unified memory, the Apple M5 Ultra (512GB) can run 30+ open-source models from our database, including Qwen3.8 2.4T A95B, Qwen3.8 27B, DeepSeek V4 Flash.
What's the largest LLM I can run on a Apple M5 Ultra (512GB)?
The biggest model that fits is approximately 685B. Larger models would need to be quantized further or won't fit at all.
Is 512GB of unified memory enough for local AI?
Yes — 512GB comfortably runs most popular open-source models including 30B-class LLMs at Q4_K_M.