Hugging Face's logo

noctrex
/
Huihui-Ling-mini-2.0-abliterated-i1-GGUF

Text Generation
GGUF
imatrix
conversational
Model card Files
xet
 Community

These are quantizations of the model Huihui-Ling-mini-2.0-abliterated.

These quantizations were created using an imatrix merged from combined_all_large and harmful.txt to leverage the abliterated nature of the model.

Downloads last month
34
GGUF
Model size
16B params
Architecture
bailingmoe2
Hardware compatibility
Log In to add your hardware

3-bit

4-bit

5-bit

6-bit

8-bit

View +1 variant
Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for noctrex/Huihui-Ling-mini-2.0-abliterated-i1-GGUF

Base model

inclusionAI/Ling-mini-base-2.0
Finetuned
inclusionAI/Ling-mini-2.0
Quantized
huihui-ai/Huihui-Ling-mini-2.0-abliterated
Quantized
(8)
this model

Collection including noctrex/Huihui-Ling-mini-2.0-abliterated-i1-GGUF