exolabs/qwen3-5-9b-optiq-4bit-text-dequant-bf16
Private dequantized BF16 export for vLLM validation.
- Internal model id:
qwen3-5-9b-optiq-4bit - MLX source:
mlx-community/Qwen3.5-9B-OptiQ-4bit - Original HF comparison model:
Qwen/Qwen3.5-9B - Export dtype:
bfloat16 - Text-only export:
False
This checkpoint is the result of dequantizing the quantized MLX checkpoint. It is not the original upstream BF16 checkpoint.
- Downloads last month
- 68
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support