Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

692

Base only

Active filters: ggml

mudler/parakeet-cpp-gguf

Automatic Speech Recognition • 0.6B • Updated 7 days ago • 4.48k • 41

unsloth/LTX-2.3-GGUF

Image-to-Video • 21B • Updated Apr 20 • 203k • 458

unsloth/FLUX.2-klein-9B-GGUF

Image-to-Image • 9B • Updated Jan 16 • 71.6k • 238

unsloth/Z-Image-Turbo-GGUF

Text-to-Image • 6B • Updated Jan 8 • 35.6k • 206

unsloth/FLUX.2-klein-4B-GGUF

Image-to-Image • 4B • Updated Jan 16 • 166k • 158

unsloth/Z-Image-GGUF

Text-to-Image • 6B • Updated Jan 28 • 7.51k • 174

LocalAI-io/LocalVQE

Audio-to-Audio • 1.29M • Updated 15 days ago • 1.47k • 42

Serveurperso/Qwen3-TTS-GGUF

Text-to-Speech • 0.9B • Updated May 11 • 4.42k • 8

Serveurperso/OmniVoice-GGUF

Text-to-Speech • 0.6B • Updated Apr 30 • 6.05k • 26

mudler/locate-anything.cpp-gguf

Object Detection • 4B • Updated 1 day ago • 295 • 2

unsloth/Qwen-Image-Layered-GGUF

Image-Text-to-Image • 20B • Updated Jan 9 • 3.15k • 54

unsloth/Qwen-Image-Edit-GGUF

Image-to-Image • 20B • Updated Dec 22, 2025 • 3.04k • 24

unsloth/LTX-2-GGUF

Image-to-Video • 19B • Updated Jan 22 • 4.45k • 132

unsloth/FLUX.2-klein-base-9B-GGUF

Image-to-Image • 9B • Updated Jan 15 • 11.1k • 35

cstr/parakeet-tdt-0.6b-v3-GGUF

Automatic Speech Recognition • 0.6B • Updated Apr 27 • 1.85k • 7

cstr/qwen3-asr-1.7b-GGUF

Automatic Speech Recognition • 2B • Updated Apr 11 • 3.06k • 10

unsloth/ERNIE-Image-GGUF

Text-to-Image • 8B • Updated Apr 14 • 2.93k • 69

unsloth/ERNIE-Image-Turbo-GGUF

Text-to-Image • 8B • Updated Apr 14 • 19.1k • 217

cstr/vibevoice-realtime-0.5b-GGUF

Text-to-Speech • 1B • Updated May 1 • 1.04k • 3

cstr/VibeVoice-7B-GGUF

Automatic Speech Recognition • 9B • Updated Apr 26 • 606 • 1

mudler/vibevoice.cpp-models

Updated Apr 28 • 16k • 11

cstr/qwen3-tts-1.7b-base-GGUF

Text-to-Speech • 2B • Updated May 1 • 401 • 2

kokoso/whisper-large-v3-turbo_pl

Automatic Speech Recognition • Updated May 7 • 2

cstr/MOSS-Audio-4B-Instruct-GGUF

Audio-Text-to-Text • 5B • Updated 8 days ago • 402 • 1

CreativeHub008/OmniVoice-GGUF

Text-to-Speech • 0.6B • Updated 7 days ago • 362 • 1

batiai/batisay-ko-large-GGUF

Automatic Speech Recognition • Updated 2 days ago • 1

malteos/bloom-6b4-clp-german

Text Generation • 6B • Updated Apr 6, 2024 • 811 • 37

nouamanetazi/bloomz-560m-ggml

Updated Mar 15, 2023 • 4

maximeseth/alpaca-native-7B-ggml

Updated Mar 26, 2023 • 5 • 1

bertin-project/bertin-gpt-j-6B-alpaca

Text Generation • 6B • Updated Nov 10, 2024 • 491 • 7