HuggingFace · 3B · Dense

Lightweight multilingual reasoning お使いの GPU や Mac で SmolLM3 3B が動くか確認——最小 1.7 GB、推奨 2.8 GB。

2025-07128K context

量子化オプション

量子化ビットVRAM品質状態
Q2_K21.5 GBlow
Q3_K_M31.8 GBmoderate
Q4_K_M42 GBgood
Q5_K_M52.4 GBgood
Q6_K62.8 GBexcellent
Q8_083.6 GBexcellent
F16166.6 GBlossless

Can I run SmolLM3 3B locally?

Can I run SmolLM3 3B locally?
SmolLM3 3B needs about 1.7 GB of memory at a minimum and 2.8 GB recommended. Open this page to grade it against your GPU or Mac, then run it with runai, Ollama or LM Studio.
How much VRAM does SmolLM3 3B need?
At Q4_K_M, SmolLM3 3B uses about 2 GB of VRAM. Higher quants need more memory; lower quants fit tighter cards with a quality tradeoff.