README.md

metadata

base_model: Sao10K/L3.1-8B-Niitama-v1.1
quantized_by: Lewdiculous
library_name: transformers
license: unlicense
inference: false
language:
  - en

"Lllama 3.1 experiments."

Use the latest version of KoboldCpp.

Q4_0 ARM/Mobile quants here: L3.1-8B-Niitama-v1.1-GGUF-ARM-Imatrix-Supplementary.

Quant request #73.

My GGUF-IQ-Imatrix quants for Sao10K/L3.1-8B-Niitama-v1.1.