exolabs/qwen3-5-9b-optiq-4bit-text-dequant-bf16

Private dequantized BF16 export for vLLM validation.

  • Internal model id: qwen3-5-9b-optiq-4bit
  • MLX source: mlx-community/Qwen3.5-9B-OptiQ-4bit
  • Original HF comparison model: Qwen/Qwen3.5-9B
  • Export dtype: bfloat16
  • Text-only export: False

This checkpoint is the result of dequantizing the quantized MLX checkpoint. It is not the original upstream BF16 checkpoint.

Downloads last month
68
Safetensors
Model size
9B params
Tensor type
F32
·
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support