Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

339

Base only

Active filters: fp4

nvidia/Qwen3.6-35B-A3B-NVFP4

Text Generation • 19B • Updated 3 days ago • 1.22M • 225

nvidia/Qwen3.5-122B-A10B-NVFP4

Text Generation • 65B • Updated 13 days ago • 9.73k • 17

RazielXYZ/Nex-N2-Pro-NVFP4

Text Generation • Updated 9 days ago • 1.12k • 4

nvidia/GLM-5.1-NVFP4

Text Generation • 382B • Updated 19 days ago • 46.7k • 36

GulfCoastAI/Mistral-Small-4-119B-Heretic-NVFP4

68B • Updated 6 days ago • 110 • 4

brandonmusic/Rio-3.5-Open-397B-NVFP4

Text Generation • Updated 1 day ago • 233 • 4

AEON-7/Gemma-4-26B-A4B-it-Uncensored-NVFP4

Text Generation • 15B • Updated about 13 hours ago • 8.75k • 20

OptimizeLLM/Qwen3.5-122B-A10B-heretic-MTP-NVFP4

Text Generation • 74B • Updated Apr 11 • 18.1k • 7

nvidia/Kimi-K2.6-NVFP4

Text Generation • Updated about 1 month ago • 893k • 37

AxionML/Gemma-4-12B-NVFP4

Image-Text-to-Text • 8B • Updated 11 days ago • 39.5k • 3

Mapika/MiniMax-M3-NVFP4

245B • Updated 3 days ago • 598 • 2

nvidia/Qwen3-30B-A3B-NVFP4

Text Generation • 16B • Updated Sep 10, 2025 • 41.1k • 34

nvidia/Phi-4-multimodal-instruct-NVFP4

4B • Updated Sep 5, 2025 • 7.03k • 12

Sophia-AI/Qwen3-Next-80B-A3B-Instruct-NVFP4

Text Generation • Updated Feb 20 • 16 • 1

AEON-7/Gemma-4-31B-it-DECKARD-HERETIC-Uncensored-NVFP4

Text Generation • 18B • Updated 15 days ago • 2.11k • 11

AEON-7/Qwen3.6-35B-A3B-heretic-NVFP4

Image-Text-to-Text • 21B • Updated 6 days ago • 18.3k • 48

sakamakismile/LFM2.5-8B-A1B-NVFP4

Text Generation • 5B • Updated 15 days ago • 461 • 4

AEON-7/Step-3.7-Flash-AEON-Ultimate-Abliterated-NVFP4

Image-Text-to-Text • 104B • Updated 15 days ago • 456 • 5

melcheikh/gemma-4-31B-it-qat-NVFP4-Blackwell

Text Generation • 17B • Updated 7 days ago • 4.51k • 3

melcheikh/gemma-4-31B-it-qat-assistant-NVFP4-Blackwell

Text Generation • 0.4B • Updated 7 days ago • 430 • 4

coolthor/Sulphur-2-distilled-NVFP4

Text-to-Video • Updated 13 days ago • 539 • 2

mengqin1/RedidreamNSFWI1-bnb-4bit

Updated May 10, 2025 • 1

qingcheng-ai/QwQ-32B-fp4

Text Generation • 19B • Updated Jun 24, 2025 • 4 • 3

qingcheng-ai/Qwen3-32B-fp4

Text Generation • 19B • Updated May 19, 2025 • 43 • 4

qingcheng-ai/Qwen3-8B-fp4

Text Generation • 5B • Updated May 19, 2025 • 5 • 1

RedHatAI/Qwen3-30B-A3B-NVFP4

Text Generation • 17B • Updated Dec 4, 2025 • 67.4k • 2

RedHatAI/Llama-3.1-70B-Instruct-NVFP4

Text Generation • 41B • Updated Nov 21, 2025 • 117

RedHatAI/Llama-3.1-70B-Instruct-NVFP4A16

Text Generation • 41B • Updated Jun 30, 2025 • 3

RedHatAI/Qwen3-32B-NVFP4

Text Generation • 19B • Updated Nov 21, 2025 • 5.04k • 9

RedHatAI/Qwen3-32B-NVFP4A16

Text Generation • 19B • Updated Jun 30, 2025 • 22 • 2