Minthy
/

Qwen3-235B-A22B-Instruct-2507-exl3-5.0bpw

Text Generation

Model card Files Files and versions

Exl3 5.0bpw h6 quantization of Qwen/Qwen3-235B-A22B-Instruct-2507 using 69750c8 commit of Exllamav3

148.4gb, requires ~160gb with 64k unquantized context.

Downloads last month: 2

Safetensors

Model size

74B params

Tensor type

F16

·

I16

·

Model tree for Minthy/Qwen3-235B-A22B-Instruct-2507-exl3-5.0bpw

Base model

Qwen/Qwen3-235B-A22B-Instruct-2507

Quantized

(58)

this model