gemma-4-E4B-it-GGUF

Recommended way to run this model:

llama-server -hf ggml-org/gemma-4-E4B-it-GGUF

Then, access http://localhost:8080

Downloads last month
107,541
GGUF
Model size
8B params
Architecture
gemma4
Hardware compatibility
Log In to add your hardware

4-bit

8-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ggml-org/gemma-4-E4B-it-GGUF

Quantized
(73)
this model

Space using ggml-org/gemma-4-E4B-it-GGUF 1

Collections including ggml-org/gemma-4-E4B-it-GGUF