GPU GUIDE · AMD
Best AI models for the
AMD Instinct MI325X
The AMD Instinct MI325X has 256GB of VRAM. Below are the top 30 open-source AI models that fit, ranked by composite benchmark score. Each row shows the best quantization that fits your hardware.
VRAM
256GB
Brand
amd
Models that fit
30
Generation
Instinct
Top 30 models for the AMD Instinct MI325X
01
89.7MiMo V2.5 Pro
320BBest fit: Q5_K_M · 228.2GBCan I run it? →
02
83.3Qwen 3.6 Plus
235BBest fit: Q8_0 · 250.7GBCan I run it? →
03
82.9GLM-5
230BBest fit: Q8_0 · 245.4GBCan I run it? →
04
77.5DeepSeek V4 Flash
37.0BBest fit: fp16 · 75.0GBCan I run it? →
05
76.4Qwen 3.6 27B
27.0BBest fit: fp16 · 55.0GBCan I run it? →
06
74.9MiMo V2 Omni
120BBest fit: fp16 · 241.0GBCan I run it? →
07
75.1Qwen 3.5 397B A17B
397BBest fit: Q4_K_M · 241.7GBCan I run it? →
08
72.5Qwen 3.6 35B A3B
35.0BBest fit: fp16 · 71.0GBCan I run it? →
09
70.1Qwen3.5-27B
27.8BBest fit: f32 · 112.2GBCan I run it? →
10
69.3Qwen 3.5 122B A10B
122BBest fit: fp16 · 245.0GBCan I run it? →
11
65.4Mistral Medium 3.5 128B
128BBest fit: Q6_K · 106.2GBCan I run it? →
12
65.3Gemma 4 31B (free)
31.0BBest fit: fp16 · 63.0GBCan I run it? →
13
64.4Qwen 3.5 Omni Plus
235BBest fit: Q8_0 · 250.7GBCan I run it? →
14
61.9Qwen 3.5 35B A3B
35.0BBest fit: fp16 · 71.0GBCan I run it? →
15
59.9NVIDIA Nemotron 3 Super 120B A12B BF16
124BBest fit: fp16 · 248.2GBCan I run it? →
16
60.0NVIDIA Nemotron 3 Super
340BBest fit: Q5_K_M · 242.4GBCan I run it? →
17
55.4GPT-OSS 120B
120BBest fit: fp16 · 241.0GBCan I run it? →
18
54.0Qwen 3.5 9B
9.0BBest fit: fp16 · 19.0GBCan I run it? →
19
53.8gemma 4 31B
32.7BBest fit: fp16 · 66.4GBCan I run it? →
20
52.0Gemma 4 26B A4B (free)
26.5BBest fit: f32 · 107.0GBCan I run it? →
21
49.2Qwen3 235B A22B Thinking 2507
235BBest fit: Q6_K · 194.7GBCan I run it? →
22
46.3Mistral Small 4
119BBest fit: fp16 · 239.8GBCan I run it? →
23
45.1Qwen 3.5 4B
4.0BBest fit: fp16 · 9.0GBCan I run it? →
24
45.0Qwen 3 Next 80B A3B
80.0BBest fit: fp16 · 161.0GBCan I run it? →
25
44.5Qwen3 Next 80B A3B Thinking
81.3BBest fit: Q8_0 · 87.4GBCan I run it? →
26
44.0GLM-4.5
358BBest fit: Q5_K_M · 255.2GBCan I run it? →
27
41.6Qwen 3 235B A22B Instruct 2507
235BBest fit: Q8_0 · 250.7GBCan I run it? →
28
40.8GPT-OSS 20B
20.0BBest fit: fp16 · 41.0GBCan I run it? →
29
40.5Nemotron 3 Nano 30B A3B (free)
31.6BBest fit: Q8_0 · 34.6GBCan I run it? →
30
37.4Qwen3 30B A3B Thinking 2507
30.5BBest fit: Q8_0 · 33.4GBCan I run it? →
Advertisement
FAQ — running AI on the AMD Instinct MI325X
How many AI models can the AMD Instinct MI325X run?
With 256GB of VRAM, the AMD Instinct MI325X can run 30+ open-source models from our database, including MiMo V2.5 Pro, Qwen 3.6 Plus, GLM-5.
What's the largest LLM I can run on a AMD Instinct MI325X?
The biggest model that fits is approximately 397B. Larger models would need to be quantized further or won't fit at all.
Is 256GB of VRAM enough for local AI?
Yes — 256GB comfortably runs most popular open-source models including 30B-class LLMs at Q4_K_M.