Q4 で 45 モデル · 12 GB 枠

Local AI models for 12GB VRAM

12 GB unlocks the 12B–14B class at Q4 and leaves headroom for context. It is the step up from an 8 GB card without jumping to 16 GB workstation memory.

典型的な構成： 12B–14B dense models, or smaller mixture-of-experts. · 例：RTX 4070

サイズは Q4_K_M に少しのランタイムオーバーヘッドを加えた値です。お使いのマシンで全カタログを評価または特定の GPU を選ぶ.

Common questions

What can I run on a 12GB GPU?
Most 12B–14B instruct models at Q4, plus 7B–9B at higher quality. Compact image models run well. Video still wants more memory.