Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

115

Base only

Active filters: mxfp8

rdtand/Qwen3.6-27B-PrismaQuant-5.5bit-vllm

Image-Text-to-Text • 18B • Updated Apr 22 • 13.4k • 24

rdtand/Qwen3.6-35B-A3B-PrismaQuant-4.75bit-vllm

Image-Text-to-Text • 21B • Updated Apr 21 • 85.6k • 29

cyburn/Qwen3.6-35B-A3B-PrismaQuant-4.9bit-vllm

Image-Text-to-Text • 21B • Updated Apr 22 • 344 • 4

cyburn/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-PrismaQuant-8bit-vllm

Text Generation • 27B • Updated Apr 28 • 888 • 2

AEON-7/Gemma-4-12B-it-AEON-Abliterated-MLX-8bit

Image-Text-to-Text • 4B • Updated 2 days ago • 1.53k • 1

LibraxisAI/Qwen3-VL-235B-A22B-Instruct-mlx-mxfp8

Image-Text-to-Text • 67B • Updated about 1 month ago • 223 • 1

nightmedia/Qwen3-MOE-4x8B-Janus-Blossom-Claude-Gemini-mxfp8-mlx

Text Generation • 24B • Updated Jan 31 • 35

Foxtr0t/Ministral-3-14B-Reasoning-2512-mlx-mxfp8

4B • Updated Feb 8 • 32

vincentzed-hf/Kimi-K2.5-MXFP8

Image-Text-to-Text • 1T • Updated Feb 11 • 5 • 1

TheCluster/GLM-4.6V-Flash-Heretic-MLX-mxfp8

Image-Text-to-Text • 10B • Updated Feb 27 • 42

TheCluster/Qwen3.5-35B-A3B-Heretic-MLX-mxfp8

Image-Text-to-Text • 35B • Updated Apr 17 • 89 • 4

zianglih/Qwen3-30B-A3B-MXFP8

Text Generation • 31B • Updated Mar 2 • 3

zianglih/Qwen3-30B-A3B-Instruct-2507-MXFP8

Text Generation • 31B • Updated Mar 2 • 268

TheCluster/Qwen3.5-9B-Heretic-MLX-mxfp8

Image-Text-to-Text • 9B • Updated Mar 15 • 96 • 2

AxionML/Kimi-K2.5-MXFP8

Image-Text-to-Text • 1T • Updated Mar 3 • 21

TheCluster/Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED-MLX-mxfp8

Image-Text-to-Text • 9B • Updated Apr 25 • 16k • 28

zianglih/Qwen2.5-0.5B-Instruct-MXFP8

Text Generation • 0.5B • Updated Mar 4 • 64

TheCluster/Qwen3.5-4B-Heretic-MLX-mxfp8

Image-Text-to-Text • 1B • Updated Mar 5 • 79 • 2

TheCluster/Qwen3.5-27B-Heretic-Text-MLX-mxfp8

Text Generation • 27B • Updated Mar 8 • 15

AITRADER/Jackrong-Qwen3.5-9B-Claude-Reasoning-abliterated-mxfp8-MLX

Text Generation • 3B • Updated Mar 13 • 219 • 2

AITRADER/Jackrong-Qwen3.5-2B-Claude-Reasoning-abliterated-mxfp8-MLX

Text Generation • 0.9B • Updated Mar 13 • 67

AITRADER/Jackrong-Qwen3.5-4B-Claude-Reasoning-abliterated-mxfp8-MLX

Text Generation • 2B • Updated Mar 13 • 88 • 1

zianglih/Qwen3-30B-A3B-MXFP8-last-8-BF16

Text Generation • 31B • Updated Mar 9 • 29

Winnougan/LTX-2.3-INT8

Updated Mar 27 • 9

TheCluster/Qwen3.5-9B-Ultra-Heretic-MLX-mxfp8

Image-Text-to-Text • 9B • Updated Mar 17 • 76 • 2

TheCluster/Qwen3.5-40B-Claude-4.5-Opus-High-Reasoning-Thinking-MLX-mxfp8

Image-Text-to-Text • 39B • Updated Mar 16 • 27 • 1

TheCluster/Qwen3.5-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking-MLX-mxfp8

Image-Text-to-Text • 39B • Updated Mar 16 • 246 • 4

wbkou/Qwen3.5-40B-Claude-4.5-Opus-Distilled-MLX-mxfp8

Image-Text-to-Text • 39B • Updated Mar 16 • 13

TheCluster/Crow-9B-HERETIC-4.6-MLX-mxfp8

Image-Text-to-Text • 9B • Updated Mar 17 • 40 • 1

TheCluster/Qwen3.5-9B-Uncensored-HauhauCS-Aggressive-MLX-mxfp8

Image-Text-to-Text • 9B • Updated Mar 17 • 985 • 5