Hugging Face's logo

Lewdiculous
/
Chaos_RP_l3_8B-GGUF-IQ-Imatrix

GGUF
roleplay
llama3
sillytavern
Inference Endpoints
Model card Files Community
1
Lewdiculous commited on
Commit
183ea5f
·
verified ·
1 Parent(s): 404cdb2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -12,6 +12,10 @@ license: apache-2.0
12
 
13
  GGUF-IQ-Imatrix quants for [jeiku/Chaos_RP_l3_8B](https://huggingface.co/jeiku/Chaos_RP_l3_8B).
14
 
 
 
 
 
15
  > [!WARNING]
16
  > Recommended presets [here](https://huggingface.co/Lewdiculous/Model-Requests/tree/main/data/presets/cope-llama-3-0.1) or [here](https://huggingface.co/Virt-io/SillyTavern-Presets). <br>
17
  > Use the latest version of KoboldCpp. **Use the provided presets.** <br>
 
12
 
13
  GGUF-IQ-Imatrix quants for [jeiku/Chaos_RP_l3_8B](https://huggingface.co/jeiku/Chaos_RP_l3_8B).
14
 
15
+ > [!IMPORTANT]
16
+ > **Updated!**
17
+ > These quants have been redone with the fixes from [llama.cpp/pull/6920](https://github.com/ggerganov/llama.cpp/pull/6920) in mind.
18
+
19
  > [!WARNING]
20
  > Recommended presets [here](https://huggingface.co/Lewdiculous/Model-Requests/tree/main/data/presets/cope-llama-3-0.1) or [here](https://huggingface.co/Virt-io/SillyTavern-Presets). <br>
21
  > Use the latest version of KoboldCpp. **Use the provided presets.** <br>