| --- |
| base_model: Sao10K/L3.1-8B-Niitama-v1.1 |
| quantized_by: Lewdiculous |
| library_name: transformers |
| license: unlicense |
| inference: false |
| language: |
| - en |
| --- |
| |
| **"Lllama 3.1 experiments."** |
|
|
| > [!TIP] |
| > [**Use the latest version of KoboldCpp.**](https://github.com/LostRuins/koboldcpp/releases/latest) |
|
|
| > [!NOTE] |
| > **Q4_0 ARM/Mobile** quants here: [L3.1-8B-Niitama-v1.1-GGUF-ARM-Imatrix-Supplementary](https://huggingface.co/Aetherarchio/L3.1-8B-Niitama-v1.1-GGUF-ARM-Imatrix-Supplementary). |
| |
| [Quant request #73.](https://huggingface.co/Lewdiculous/Model-Requests/discussions/73) |
| |
| My GGUF-IQ-Imatrix quants for [Sao10K/L3.1-8B-Niitama-v1.1](https://huggingface.co/Sao10K/L3.1-8B-Niitama-v1.1). |
| |
|  |
| |
