GPU GUIDE · NVIDIA
Best AI models for the
NVIDIA B100
The NVIDIA B100 has 192GB of VRAM. Below are the top 30 open-source AI models that fit, ranked by composite benchmark score. Each row shows the best quantization that fits your hardware.
VRAM
192GB
Brand
nvidia
Models that fit
30
Generation
Data Center
Top 30 models for the NVIDIA B100
01
67.1DeepSeek V4 Flash
37.0BBest fit: fp16 · 75.0GBCan I run it? →
02
65.9Qwen 3.6 Plus
235BBest fit: Q5_K_M · 167.8GBCan I run it? →
03
63.6MiniMax M2.7
229BBest fit: Q6_K · 189.4GBCan I run it? →
04
61.8Qwen 3.6 27B
27.0BBest fit: fp16 · 55.0GBCan I run it? →
05
60.7MiMo V2 Omni
120BBest fit: Q8_0 · 128.5GBCan I run it? →
06
56.3Qwen3.5-27B
27.8BBest fit: f32 · 112.2GBCan I run it? →
07
53.8Qwen 3.5 122B A10B
122BBest fit: Q8_0 · 130.6GBCan I run it? →
08
52.7Qwen 3.6 35B A3B
35.0BBest fit: fp16 · 71.0GBCan I run it? →
09
51.1Qwen 3.5 Omni Plus
235BBest fit: Q5_K_M · 167.8GBCan I run it? →
10
48.9Gemma 4 31B
31.0BBest fit: fp16 · 63.0GBCan I run it? →
11
48.8Qwen 3.5 35B A3B
35.0BBest fit: fp16 · 71.0GBCan I run it? →
12
45.0Qwen 3 Next 80B A3B
80.0BBest fit: fp16 · 161.0GBCan I run it? →
13
42.8Gemma 4 26B A4B
26.5BBest fit: f32 · 107.0GBCan I run it? →
14
42.3NVIDIA Nemotron 3 Super 120B A12B BF16
124BBest fit: Q8_0 · 132.3GBCan I run it? →
15
36.7Devstral 2
24.0BBest fit: fp16 · 49.0GBCan I run it? →
16
36.4gemma 4 12B it
12.0BBest fit: f32 · 49.0GBCan I run it? →
17
35.7Qwen 3.5 9B
9.0BBest fit: fp16 · 19.0GBCan I run it? →
18
33.5Qwen 3.5 4B
4.0BBest fit: fp16 · 9.0GBCan I run it? →
19
31.9Devstral 2 2512
125BBest fit: Q8_0 · 133.8GBCan I run it? →
20
32.7Qwen3 235B A22B Thinking 2507
235BBest fit: Q4_K_M · 143.5GBCan I run it? →
21
31.7Devstral Small 2
7.0BBest fit: fp16 · 15.0GBCan I run it? →
22
30.6Seed OSS 36B Instruct
36.2BBest fit: Q8_0 · 39.5GBCan I run it? →
23
30.3Qwen 3 235B A22B Instruct 2507
235BBest fit: Q5_K_M · 167.8GBCan I run it? →
24
29.1Devstral Small 2 24B Instruct 2512
24.0BBest fit: f32 · 97.0GBCan I run it? →
25
27.9Qwen3 Next 80B A3B Thinking
81.3BBest fit: Q4_K_M · 50.3GBCan I run it? →
26
26.7Ministral 3 14B
14.0BBest fit: fp16 · 29.0GBCan I run it? →
27
25.0Ministral 3 8B
8.0BBest fit: fp16 · 17.0GBCan I run it? →
28
25.0Gemma 4 E2B
2.0BBest fit: f32 · 9.0GBCan I run it? →
29
24.9Nemotron 3 Nano Omni (free)
33.0BBest fit: Q8_0 · 36.1GBCan I run it? →
30
24.8GPT-OSS 20B
21.5BBest fit: fp16 · 44.0GBCan I run it? →
Advertisement
FAQ — running AI on the NVIDIA B100
How many AI models can the NVIDIA B100 run?
With 192GB of VRAM, the NVIDIA B100 can run 30+ open-source models from our database, including DeepSeek V4 Flash, Qwen 3.6 Plus, MiniMax M2.7.
What's the largest LLM I can run on a NVIDIA B100?
The biggest model that fits is approximately 235B. Larger models would need to be quantized further or won't fit at all.
Is 192GB of VRAM enough for local AI?
Yes — 192GB comfortably runs most popular open-source models including 30B-class LLMs at Q4_K_M.