kernalkue
/

Sapphira-L3.3-70b-0.1-exl3-6.0bpw-h6

Model card Files Files and versions

6.0bpw EXL3 Quant of BruhzWater/Sapphira-L3.3-70b-0.1

6.0bpw H6 EXL3 quant of BruhzWater/Sapphira-L3.3-70b-0.1 using exllamav3 for quantization.

Downloads last month: -

Safetensors

Model size

27B params

Tensor type

F16

·

I16

·

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for kernalkue/Sapphira-L3.3-70b-0.1-exl3-6.0bpw-h6

Base model

BruhzWater/Sapphira-L3.3-70b-0.1

Quantized

(8)

this model