Lewdiculous
/

Chaos_RP_l3_8B-GGUF-IQ-Imatrix

Inference Endpoints

Model card Files Files and versions Community

Lewdiculous commited on Apr 30

Commit

4f9ae40

•

1 Parent(s): 782c319

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -14,7 +14,8 @@ GGUF-IQ-Imatrix quants for [jeiku/Chaos_RP_l3_8B](https://huggingface.co/jeiku/C
 > [!IMPORTANT]
 > **Updated!**
-> These quants have been redone with the fixes from [llama.cpp/pull/6920](https://github.com/ggerganov/llama.cpp/pull/6920) in mind.
 > [!NOTE]
 > **Quant:** <br>

 > [!IMPORTANT]
 > **Updated!**
+> These quants have been redone with the fixes from [llama.cpp/pull/6920](https://github.com/ggerganov/llama.cpp/pull/6920) in mind. <br>
+> Use **KoboldCpp version 1.64** or higher.
 > [!NOTE]
 > **Quant:** <br>