GLM-4.5 Air

MIT

Z.ai · 106B (12B active) · 專家混合(MoE)

Consumer-friendly GLM MoE — 12B active, strong agentic & tool use 看看你的 GPU 或 Mac 跑不跑得動 GLM-4.5 Air——最低 59.2 GB,建議 98.7 GB。

2025-07128K context

專家混合(MoE)

專家總数: 128
啟用專家: 8
啟用参数: 12.0B

量化選項

量化位元VRAM品質状態
Q2_K234.4 GBlow
Q3_K_M348 GBmoderate
Q4_K_M454.8 GBgood
Q5_K_M568.4 GBgood
Q6_K681.9 GBexcellent
Q8_08109.1 GBexcellent
F1616217.7 GBlossless

Can I run GLM-4.5 Air locally?

Can I run GLM-4.5 Air locally?
GLM-4.5 Air needs about 59.2 GB of memory at a minimum and 98.7 GB recommended. Open this page to grade it against your GPU or Mac, then run it with runai, Ollama or LM Studio.
How much VRAM does GLM-4.5 Air need?
At Q4_K_M, GLM-4.5 Air uses about 54.8 GB of VRAM. Higher quants need more memory; lower quants fit tighter cards with a quality tradeoff.