GPU GUIDE · AMD
Best AI models for the
AMD RX 7900 XTX
The AMD RX 7900 XTX has 24.0GB of VRAM. Below are the top 30 open-source AI models that fit, ranked by composite benchmark score. Each row shows the best quantization that fits your hardware.
VRAM
24.0GB
Brand
amd
Models that fit
30
Generation
RX 7000 Series
Top 30 models for the AMD RX 7900 XTX
01
67.1DeepSeek V4 Flash
37.0BBest fit: Q4_K_M · 23.4GBCan I run it? →
02
61.8Qwen 3.6 27B
27.0BBest fit: Q6_K · 23.2GBCan I run it? →
03
56.3Qwen3.5-27B
27.8BBest fit: Q6_K · 23.9GBCan I run it? →
04
52.7Qwen 3.6 35B A3B
35.0BBest fit: Q4_K_M · 22.2GBCan I run it? →
05
48.9Gemma 4 31B
31.0BBest fit: Q5_K_M · 23.0GBCan I run it? →
06
48.8Qwen 3.5 35B A3B
35.0BBest fit: Q4_K_M · 22.2GBCan I run it? →
07
42.8Gemma 4 26B A4B
26.5BBest fit: Q6_K · 22.8GBCan I run it? →
08
36.7Devstral 2
24.0BBest fit: Q6_K · 20.8GBCan I run it? →
09
36.4gemma 4 12B it
12.0BBest fit: Q8_0 · 13.8GBCan I run it? →
10
35.7Qwen 3.5 9B
9.0BBest fit: fp16 · 19.0GBCan I run it? →
11
33.5Qwen 3.5 4B
4.0BBest fit: fp16 · 9.0GBCan I run it? →
12
31.7Devstral Small 2
7.0BBest fit: fp16 · 15.0GBCan I run it? →
13
30.6Seed OSS 36B Instruct
36.2BBest fit: Q4_K_M · 22.9GBCan I run it? →
14
29.1Devstral Small 2 24B Instruct 2512
24.0BBest fit: Q6_K · 20.8GBCan I run it? →
15
26.7Ministral 3 14B
14.0BBest fit: Q8_0 · 15.9GBCan I run it? →
16
25.0Ministral 3 8B
8.0BBest fit: fp16 · 17.0GBCan I run it? →
17
25.0Gemma 4 E2B
2.0BBest fit: f32 · 9.0GBCan I run it? →
18
24.8GPT-OSS 20B
21.5BBest fit: Q8_0 · 23.8GBCan I run it? →
19
24.9Nemotron 3 Nano Omni (free)
33.0BBest fit: Q4_K_M · 21.0GBCan I run it? →
20
24.1Qwen3 30B A3B Thinking 2507
30.5BBest fit: Q5_K_M · 22.7GBCan I run it? →
21
23.6Nemotron 3 Nano 30B A3B
31.6BBest fit: Q4_K_M · 20.2GBCan I run it? →
22
22.7Qwen3 Coder 30B A3B Instruct
30.5BBest fit: Q5_K_M · 22.7GBCan I run it? →
23
22.4diffusiongemma 26B A4B it
25.8BBest fit: Q6_K · 22.3GBCan I run it? →
24
22.3QwQ 32B
32.8BBest fit: Q5_K_S · 23.6GBCan I run it? →
25
22.2Qwen3 VL 30B A3B Thinking
31.1BBest fit: Q5_K_M · 23.1GBCan I run it? →
26
19.9Qwen3 4B Thinking 2507
4.0BBest fit: fp16 · 9.0GBCan I run it? →
27
19.8gemma 4 E4B it
8.0BBest fit: fp16 · 17.0GBCan I run it? →
28
19.2Qwen3 32B
32.8BBest fit: Q5_K_S · 23.6GBCan I run it? →
29
18.4Ministral 3 14B 2512
13.9BBest fit: Q8_0 · 15.8GBCan I run it? →
30
18.3Ministral 3 3B
3.0BBest fit: fp16 · 7.0GBCan I run it? →
Advertisement
FAQ — running AI on the AMD RX 7900 XTX
How many AI models can the AMD RX 7900 XTX run?
With 24.0GB of VRAM, the AMD RX 7900 XTX can run 30+ open-source models from our database, including DeepSeek V4 Flash, Qwen 3.6 27B, Qwen3.5-27B.
What's the largest LLM I can run on a AMD RX 7900 XTX?
The biggest model that fits is approximately 37.0B. Larger models would need to be quantized further or won't fit at all.
Is 24.0GB of VRAM enough for local AI?
Yes — 24.0GB comfortably runs most popular open-source models including 30B-class LLMs at Q4_K_M.