Qwen / Qwen3.5-27B

QUANTIZED BY: UnstableLlama
Information
exl3 quantizations of Qwen3.5-27B via exllamav3.
repo generated automatically with ezexl3.
Repo Data
Quantization graph
REVISION GiB KL DIV PPL
2.00bpw 9.84 0.1746 7.6985
2.10bpw 10.09 0.1412 7.3885
3.00bpw 12.67 0.0422 6.9977
3.10bpw 12.92 0.0376 6.9582
4.00bpw 15.50 0.0170 6.9331
5.00bpw 18.34 0.0070 6.8840
6.00bpw 21.17 0.0032 6.8439
8.00bpw 26.83 0.0003 6.8605
bf16 51.75 0.0000 6.8598
SVG Catbench
2.10 bpw
2.10 bpw
3.00 bpw
3.00 bpw
3.10 bpw
3.10 bpw
4.00 bpw
4.00 bpw
5.00 bpw
5.00 bpw
6.00 bpw
6.00 bpw
8.00 bpw
8.00 bpw
CLI Download
hf download UnstableLlama/Qwen3.5-27B-exl3-4.00bpw --local-dir ./Qwen3.5-27B-exl3-4.00bpw
Downloads last month
323
Safetensors
Model size
14B params
Tensor type
F16
I16
F32
BF16
Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support

Model tree for UnstableLlama/Qwen3.5-27B-exl3-8.00bpw

Base model

Qwen/Qwen3.5-27B
Quantized
(191)
this model