---
license: unlicense
inference: false
---

**"Lllama 3.1 experiments."**

> [!TIP]
> [**Use the latest version of KoboldCpp.**](https://github.com/LostRuins/koboldcpp/releases/latest)

[Quant request #73.](https://huggingface.co/Lewdiculous/Model-Requests/discussions/73)

My GGUF-IQ-Imatrix quants for [Sao10K/L3.1-8B-Niitama-v1.1](https://huggingface.co/Sao10K/L3.1-8B-Niitama-v1.1).

![image/png](https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/2Q5ky8TvP0vLS1ulMXnrn.png)