gaunernst/gemma-3-1b-it-qat-autoawq
Text Generation • Updated • 6
Gemma 3 QAT INT4 (from GGUF)
Convert official Gemma 3 QAT GGUF to AutoAWQ and compressed-tensors format for ease of deployment
-
-
gaunernst/gemma-3-4b-it-qat-autoawq
Image-Text-to-Text • Updated • 347 • 2 -
gaunernst/gemma-3-12b-it-qat-autoawq
Image-Text-to-Text • 12B • Updated • 99 • 7 -
gaunernst/gemma-3-27b-it-qat-autoawq
Image-Text-to-Text • 27B • Updated • 485 • 12 -
gaunernst/gemma-3-1b-it-qat-compressed-tensors
Text Generation • Updated • 8 -
gaunernst/gemma-3-4b-it-qat-compressed-tensors
Image-Text-to-Text • Updated • 69 • 3 -
gaunernst/gemma-3-12b-it-qat-compressed-tensors
Image-Text-to-Text • 13B • Updated • 436 • 2 -
gaunernst/gemma-3-27b-it-qat-compressed-tensors
Image-Text-to-Text • 28B • Updated • 125 • 13 -
google/gemma-3-1b-it-qat-q4_0-gguf
Text Generation • 1.0B • Updated • 599 • 131 -
google/gemma-3-4b-it-qat-q4_0-gguf
Image-Text-to-Text • 4B • Updated • 9.25k • 265 -
google/gemma-3-12b-it-qat-q4_0-gguf
Image-Text-to-Text • 12B • Updated • 4.33k • 279 -
google/gemma-3-27b-it-qat-q4_0-gguf
Image-Text-to-Text • 27B • Updated • 349 • 399