|
--- |
|
base_model: Sao10K/L3.1-8B-Niitama-v1.1 |
|
quantized_by: Lewdiculous |
|
library_name: transformers |
|
license: unlicense |
|
inference: false |
|
language: |
|
- en |
|
--- |
|
|
|
**"Lllama 3.1 experiments."** |
|
|
|
> [!TIP] |
|
> [**Use the latest version of KoboldCpp.**](https://github.com/LostRuins/koboldcpp/releases/latest) |
|
|
|
[Quant request #73.](https://huggingface.co/Lewdiculous/Model-Requests/discussions/73) |
|
|
|
My GGUF-IQ-Imatrix quants for [Sao10K/L3.1-8B-Niitama-v1.1](https://huggingface.co/Sao10K/L3.1-8B-Niitama-v1.1). |
|
|
|
![image/png](https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/2Q5ky8TvP0vLS1ulMXnrn.png) |
|
|