Qwen / Qwen3.5-27B

QUANTIZED BY: UnstableLlama

Information

exl3 quantizations of Qwen3.5-27B via exllamav3.
repo generated automatically with ezexl3.

Repo Data

REVISION	GiB	KL DIV	PPL
2.00bpw	9.84	0.1746	7.6985
2.10bpw	10.09	0.1412	7.3885
3.00bpw	12.67	0.0422	6.9977
3.10bpw	12.92	0.0376	6.9582
4.00bpw	15.50	0.0170	6.9331
5.00bpw	18.34	0.0070	6.8840
6.00bpw	21.17	0.0032	6.8439
8.00bpw	26.83	0.0003	6.8605
bf16	51.75	0.0000	6.8598

SVG Catbench

2.10 bpw	3.00 bpw	3.10 bpw	4.00 bpw
5.00 bpw	6.00 bpw	8.00 bpw

CLI Download

hf download UnstableLlama/Qwen3.5-27B-exl3-4.00bpw --local-dir ./Qwen3.5-27B-exl3-4.00bpw

Safetensors

Model size

14B params

Tensor type

F16

I16

F32

BF16

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for UnstableLlama/Qwen3.5-27B-exl3-8.00bpw

Base model

Quantized

(191)

this model