Can I Run / Ministral 3 3B 2512 / on NVIDIA RTX 3080 10GB

Can I Run Ministral 3 3B 2512 on a NVIDIA RTX 3080 10GB?

Yes

Runs at full precision (fp16). Zero quality loss.

Model size
3.8B
GPU memory
10.0GB
Smallest quant
Q2_K
Best fit
fp16

12 quantizations fit your 10.0GB

QuantMin VRAMRecommendedFile sizeHeadroom
fp16BEST8.6 GB10.1 GB0.8 GB+1.4 GB
Q8_05.0 GB6.5 GB3.6 GB+5.0 GB
Q6_K4.1 GB5.6 GB2.8 GB+5.9 GB
Q5_K_M3.7 GB5.2 GB2.5 GB+6.3 GB
Q5_K_S3.6 GB5.1 GB2.4 GB+6.4 GB
Q4_13.4 GB4.9 GB2.2 GB+6.6 GB
Q4_K_M3.3 GB4.8 GB2.1 GB+6.7 GB
Q4_K_S3.2 GB4.7 GB2.0 GB+6.8 GB
Q4_03.1 GB4.6 GB2.0 GB+6.9 GB
Q3_K_M2.6 GB4.1 GB1.8 GB+7.4 GB
Q3_K_S2.5 GB4.0 GB1.6 GB+7.5 GB
Q2_K2.3 GB3.8 GB1.5 GB+7.8 GB

Try it in the cloud first

Don't want to download Ministral 3 3B 2512 just to try it? Use a hosted API or rent a GPU by the second.

Affiliate links — we earn a commission at no cost to you.

Advertisement
Full model details
Ministral 3 3B 2512

All quant variants, benchmark scores, and use-case tags.

Best models for this GPU
NVIDIA RTX 3080 10GB

Top-ranked open-source models that fit in 10.0GB.

FAQ

Can the NVIDIA RTX 3080 10GB run Ministral 3 3B 2512?

Yes. The NVIDIA RTX 3080 10GB's 10.0GB of VRAM is enough to run Ministral 3 3B 2512 at fp16 quantization (8.6GB required).

What's the best quantization to use?

fp16 is the highest-precision quantization that fits in your 10.0GB. It uses about 8.6GB of memory and 10.1GB recommended for comfortable inference.

What if I need more headroom for context length?

KV cache memory grows with context length. The numbers above assume a baseline 2K-4K context. For long-context use (32K+), add another 2-6GB depending on the model architecture.