1bit-MONSTER/gemma-3-1b-it-GGUF

gemma-3-1b-it — GGUF (Q4_K_M)

llama.cpp project's own Q4_K_M GGUF, re-hosted with measured performance for the 1bit engine on Strix Halo.

Licensed under Google's Gemma Terms of Use.

Contents

• gemma-3-1b-it-Q4_K_M.gguf

Measured performance (Strix Halo, Vulkan)

pp512: 5791 tok/s · tg128: 83.3 tok/s

Running it

1bit serve -m gemma-3-1b-it-Q4_K_M.gguf --device vulkan

Attribution

• Base model: google/gemma-3-1b-it.
• Quantization: ggml-org/gemma-3-1b-it-GGUF.