This model was converted to MLX format from Qwen/Qwen3.5-0.8B using mlx-vlm version 0.3.12.

Conversion Command

$ uv run mlx_vlm.convert --hf-path Qwen/Qwen3.5-0.8B --mlx-path Qwen3.5-0.8B-mlx-vlm-mxfp4 -q --q-mode mxfp4 --q-group-size 32

uv dependencies

dependencies = ["mlx-lm==0.30.7", "mlx-vlm==0.3.12", "torchvision>=0.25.0"]

Downloads last month
94
Safetensors
Model size
0.2B params
Tensor type
U8
·
U32
·
BF16
·
F32
·
MLX
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for RepublicOfKorokke/Qwen3.5-0.8B-mlx-vlm-mxfp4

Quantized
(87)
this model

Collection including RepublicOfKorokke/Qwen3.5-0.8B-mlx-vlm-mxfp4