Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

376

Base only

Active filters: q4_k_m

apxi/qwen3-5-0-8b-security-triage-v4-7-gguf

Text Generation • 0.8B • Updated 18 days ago • 210

glyphsoftware/gemma-4-26b-a4b-opus-4.7-distilled-gguf

Text Generation • 25B • Updated 16 days ago • 644

fraQtl/Qwen3.6-35B-A3B-Hi-Fi-MTP-runtime

Text Generation • Updated 16 days ago • 588 • 2

johnbean393/LFM2.5-8B-A1B-Base-GGUF

Text Generation • Updated 15 days ago • 174 • 1

notSnix/Step-3.7-Flash-Q4_K_M-MTP-GGUF

Text Generation • 197B • Updated 12 days ago • 1.05k • 7

erzanugroho/gemma4-e4b-soal-ujian-sd-kurikulum-merdeka-GGUF

Text Generation • Updated 15 days ago

elmat234/qwen3-8b-aqua-Q4_K_M-gguf

8B • Updated 14 days ago • 154

edgemindroboticslabs/qwen3-0.6b-capybara-sft-GGUF

Text Generation • 0.6B • Updated 14 days ago • 179

edgemindroboticslabs/MiniCPM5-1B-GGUF

Text Generation • 1B • Updated 14 days ago • 179

JSchneemann/Mellum2-12B-A2.5B-Thinking-GGUF

Text Generation • 12B • Updated 12 days ago • 2.31k • 4

luezr/moonkaAI

Text Generation • 2B • Updated 11 days ago • 295

notSnix/Step-3.7-Flash-Q4_K_M-GGUF

Text Generation • 197B • Updated 12 days ago • 1.35k

notSnix/Step-3.7-Flash-MTP-Draft-GGUF

3B • Updated 12 days ago • 2.51k • 1

apol/gemma4-12b-it-libre-gguf

Text Generation • 12B • Updated 11 days ago • 298 • 1

jimdilkes/cair-qwen3-4b-gguf

Text Generation • 4B • Updated 11 days ago • 20

jimdilkes/cair-qwen3-8b-gguf

Text Generation • 8B • Updated 11 days ago • 19

jimdilkes/cair-qwen3-14b-gguf

Text Generation • 15B • Updated 11 days ago • 21

KeinNiemand/Kuwutu-7B-CYOA-GGUF

Text Generation • 8B • Updated 10 days ago • 1.07k

XxACCOxX/qwen3-chimera-60b-a3b-q4-k-m

Text Generation • 60B • Updated 9 days ago • 57

jairo/Llama-3.1-70B-LatamGPT-SFT-1.0-GGUF

Text Generation • 71B • Updated 8 days ago • 1.57k • 1

ZeZZm/aero-deuce-GGUF

Text Generation • 12B • Updated 8 days ago • 651

REDSOULTM/baxy-gemma4-E2B-GGUF

Text Generation • 5B • Updated 8 days ago • 309

bandtor/gemma-4-26B-A4B-it-GGUF

Image-Text-to-Text • 25B • Updated 8 days ago • 262

bandtor/gemma-4-12B-it-GGUF

Image-Text-to-Text • 12B • Updated 8 days ago • 263

bandtor/gemma-4-E4B-it-GGUF

Image-Text-to-Text • 8B • Updated 8 days ago • 259

ynanxiu/qwen25-15b-coffee-v5-gguf

2B • Updated 6 days ago • 264

micic-mihajlo/gemma-4-12b-social-post-lora-GGUF

Text Generation • 12B • Updated 7 days ago • 184

Hellohihihih/minicpm-v4_5-vqa-gguf-lmstudio

Image-Text-to-Text • 8B • Updated 6 days ago • 123

micic-mihajlo/gemma-4-12b-it-social-post-lora-GGUF

Text Generation • 12B • Updated 6 days ago • 122

kasimakpinar/mythograph-nemotron-3-nano-4b-gguf

4B • Updated 5 days ago • 332