Hugging Face's logo

altomek
/
Qwen2.5-0.5B-8bpw-EXL2

Text Generation
English
qwen2
conversational
8-bit precision
exl2
Model card Files
xet
 Community
1

Qwen2.5-0.5B

ExLlamav2 8 bpw quant of https://huggingface.co/Qwen/Qwen2.5-0.5B

Downloads last month
3
Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for altomek/Qwen2.5-0.5B-8bpw-EXL2

Base model

Qwen/Qwen2.5-0.5B
Quantized
(101)
this model