Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

compressed-tensors

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

6,924

Base only

Active filters: compressed-tensors

moonshotai/Kimi-K2.7-Code

Image-Text-to-Text • 1.1T • Updated about 10 hours ago • 56.8k • • 720

unsloth/Kimi-K2.7-Code-GGUF

Image-Text-to-Text • 1T • Updated about 13 hours ago • 9.33k • 90

moonshotai/Kimi-K2.6

Image-Text-to-Text • 1.1T • Updated 27 days ago • 2.01M • • 1.46k

CohereLabs/North-Mini-Code-1.0-fp8

Text Generation • 31B • Updated 6 days ago • 4.83k • 26

unsloth/Kimi-K2.7-Code

Image-Text-to-Text • 1.1T • Updated 2 days ago • 129 • 17

RedHatAI/diffusiongemma-26B-A4B-it-NVFP4

16B • Updated 4 days ago • 27k • 14

google/gemma-4-12B-it-qat-w4a16-ct

Any-to-Any • 13B • Updated 3 days ago • 766k • 24

moonshotai/Kimi-K2.5

Image-Text-to-Text • 1.1T • Updated Apr 30 • 1.18M • • 2.82k

google/gemma-4-E4B-it-qat-mobile-ct

Any-to-Any • 9B • Updated 10 days ago • 2.48k • 15

google/gemma-4-31B-it-qat-w4a16-ct

Image-Text-to-Text • 34B • Updated 10 days ago • 213k • 23

cyankiwi/Nex-N2-mini-AWQ-INT4

Text Generation • 37B • Updated 7 days ago • 11.1k • 5

RedHatAI/diffusiongemma-26B-A4B-it-FP8-dynamic

26B • Updated 4 days ago • 105k • 6

cyankiwi/Step-3.7-Flash-AWQ-INT4

Image-Text-to-Text • 43B • Updated 3 days ago • 4.51k • 5

unsloth/Qwen3.6-27B-NVFP4

Image-Text-to-Text • 19B • Updated 15 days ago • 357k • 83

CohereLabs/command-a-plus-05-2026-w4a4

Image-Text-to-Text • 126B • Updated about 14 hours ago • 18.2k • • 227

moonshotai/Kimi-K2-Thinking

Text Generation • 1.1T • Updated Jan 30 • 112k • • 1.7k

unsloth/Kimi-K2.6-GGUF

Image-Text-to-Text • 1T • Updated Apr 22 • 157k • 165

cyankiwi/Qwen3.6-27B-AWQ-BF16-INT4

Image-Text-to-Text • 29B • Updated Apr 30 • 221k • 38

cyankiwi/Qwen3.6-27B-AWQ-INT4

Image-Text-to-Text • 29B • Updated Apr 30 • 1.23M • 80

AEON-7/Qwen3.6-27B-AEON-Ultimate-Uncensored-NVFP4

Text Generation • 19B • Updated 7 days ago • 55.8k • 71

rdtand/Qwen3.6-27B-PrismaSCOUT-Blackwell-NVFP4-BF16-vllm

17B • Updated May 4 • 41k • 26

LordNeel/DeepSeek-V4-Flash-Acti-MTP-W4A16-FP8

Text Generation • 44B • Updated May 11 • 1.36k • 14

ayysasha/MiniMax-M2.7-AWQ-G32-STRIX-2H

Text Generation • 51B • Updated 28 days ago • 1.82k • 7

google/gemma-4-E2B-it-qat-mobile-ct

Any-to-Any • 6B • Updated 10 days ago • 2.68k • 14

google/gemma-4-E4B-it-qat-w4a16-ct

Any-to-Any • 9B • Updated 10 days ago • 47.6k • 6

cyankiwi/gemma-4-12B-it-qat-AWQ-INT4

Any-to-Any • 13B • Updated 9 days ago • 9.32k • 4

spectator2026/MiMo-V2.5-AWQ-int4

Text Generation • 53B • Updated 7 days ago • 4.72k • 3

GulfCoastAI/Mistral-Small-4-119B-Heretic-NVFP4

68B • Updated 6 days ago • 110 • 4

mistralai/Mistral-Large-3-675B-Instruct-2512

Updated Dec 19, 2025 • 2.7k • 231

mratsim/MiniMax-M2.5-BF16-INT4-AWQ

Text Generation • 39B • Updated Feb 17 • 36.8k • 41