DiffusionGemma 26B-A4B IT

Apache 2.0

Google · 26B (4B active) · 专家混合(MoE)

Discrete diffusion MoE — 1100+ tok/s on H100, multimodal (text/image/video) 看看你的 GPU 或 Mac 跑不跑得動 DiffusionGemma 26B-A4B IT——最低 14.5 GB,建議 24.2 GB。

2026-06256K context

专家混合(MoE)

专家总数: 128
启用专家: 8
启用参数: 3.8B

量化選項

量化位元VRAM品質状態
Q2_K28.8 GBlow
Q3_K_M312.2 GBmoderate
Q4_K_M413.8 GBgood
Q5_K_M517.1 GBgood
Q6_K620.5 GBexcellent
Q8_0827.1 GBexcellent
F161653.8 GBlossless

Can I run DiffusionGemma 26B-A4B IT locally?

Can I run DiffusionGemma 26B-A4B IT locally?
DiffusionGemma 26B-A4B IT needs about 14.5 GB of memory at a minimum and 24.2 GB recommended. Open this page to grade it against your GPU or Mac, then run it with runai, Ollama or LM Studio.
How much VRAM does DiffusionGemma 26B-A4B IT need?
At Q4_K_M, DiffusionGemma 26B-A4B IT uses about 13.8 GB of VRAM. Higher quants need more memory; lower quants fit tighter cards with a quality tradeoff.