GPU GUIDE · NVIDIA

Best AI models for the
NVIDIA B200

The NVIDIA B200 has 192GB of VRAM. Below are the top 30 open-source AI models that fit, ranked by composite benchmark score. Each row shows the best quantization that fits your hardware.

VRAM
192GB
Brand
nvidia
Models that fit
30
Generation
Data Center
Open full results filter →

Top 30 models for the NVIDIA B200

01

GLM-5

230B
82.9
Best fit: Q6_K · 190.5GBCan I run it? →
02

Qwen 3.6 Plus

235B
83.3
Best fit: Q5_K_M · 167.8GBCan I run it? →
03

DeepSeek V4 Flash

37.0B
77.5
Best fit: fp16 · 75.0GBCan I run it? →
04

Qwen 3.6 27B

27.0B
76.4
Best fit: fp16 · 55.0GBCan I run it? →
05

MiMo V2 Omni

120B
74.9
Best fit: Q8_0 · 128.5GBCan I run it? →
06

Qwen 3.6 35B A3B

35.0B
72.5
Best fit: fp16 · 71.0GBCan I run it? →
07

Qwen3.5-27B

27.8B
70.1
Best fit: f32 · 112.2GBCan I run it? →
08

Qwen 3.5 122B A10B

122B
69.3
Best fit: Q8_0 · 130.6GBCan I run it? →
09

Mistral Medium 3.5 128B

128B
65.4
Best fit: Q6_K · 106.2GBCan I run it? →
10

Gemma 4 31B (free)

31.0B
65.3
Best fit: fp16 · 63.0GBCan I run it? →
11

Qwen 3.5 Omni Plus

235B
64.4
Best fit: Q5_K_M · 167.8GBCan I run it? →
12

Qwen 3.5 35B A3B

35.0B
61.9
Best fit: fp16 · 71.0GBCan I run it? →
13

NVIDIA Nemotron 3 Super 120B A12B BF16

124B
59.9
Best fit: Q8_0 · 132.3GBCan I run it? →
14

GPT-OSS 120B

120B
55.4
Best fit: Q8_0 · 128.5GBCan I run it? →
15

Qwen 3.5 9B

9.0B
54.0
Best fit: fp16 · 19.0GBCan I run it? →
16

gemma 4 31B

32.7B
53.8
Best fit: fp16 · 66.4GBCan I run it? →
17

Gemma 4 26B A4B (free)

26.5B
52.0
Best fit: f32 · 107.0GBCan I run it? →
18

Qwen3 235B A22B Thinking 2507

235B
49.2
Best fit: Q4_K_M · 143.5GBCan I run it? →
19

Qwen 3.5 4B

4.0B
45.1
Best fit: fp16 · 9.0GBCan I run it? →
20

Qwen 3 Next 80B A3B

80.0B
45.0
Best fit: fp16 · 161.0GBCan I run it? →
21

Qwen3 Next 80B A3B Thinking

81.3B
44.5
Best fit: Q8_0 · 87.4GBCan I run it? →
22

Qwen 3 235B A22B Instruct 2507

235B
41.6
Best fit: Q5_K_M · 167.8GBCan I run it? →
23

GPT-OSS 20B

20.0B
40.8
Best fit: fp16 · 41.0GBCan I run it? →
24

Nemotron 3 Nano 30B A3B (free)

31.6B
40.5
Best fit: Q8_0 · 34.6GBCan I run it? →
25

Qwen3 30B A3B Thinking 2507

30.5B
37.4
Best fit: Q8_0 · 33.4GBCan I run it? →
26

Devstral 2

24.0B
36.7
Best fit: fp16 · 49.0GBCan I run it? →
27

Nemotron 3 Nano Omni 30B A3B Reasoning BF16

30.0B
35.7
Best fit: fp16 · 61.0GBCan I run it? →
28

Qwen3 Coder 30B A3B Instruct

30.5B
33.3
Best fit: Q8_0 · 33.4GBCan I run it? →
29

QwQ 32B

32.0B
32.9
Best fit: fp16 · 65.0GBCan I run it? →
30

Qwen3 VL 30B A3B Thinking

31.1B
32.8
Best fit: f32 · 125.4GBCan I run it? →
Advertisement

FAQ — running AI on the NVIDIA B200

How many AI models can the NVIDIA B200 run?

With 192GB of VRAM, the NVIDIA B200 can run 30+ open-source models from our database, including GLM-5, Qwen 3.6 Plus, DeepSeek V4 Flash.

What's the largest LLM I can run on a NVIDIA B200?

The biggest model that fits is approximately 235B. Larger models would need to be quantized further or won't fit at all.

Is 192GB of VRAM enough for local AI?

Yes — 192GB comfortably runs most popular open-source models including 30B-class LLMs at Q4_K_M.