Commit
•
ce67e0e
1
Parent(s):
90dcf36
Update README.md
Browse files
README.md
CHANGED
|
@@ -14,12 +14,14 @@ This repository hosts GGUF-IQ-Imatrix quantizations for **[Nitral-AI/Infinitely-
|
|
| 14 |
|
| 15 |
Huge thanks to [@Nitral-AI](https://huggingface.co/Nitral-AI) for merging this one.
|
| 16 |
|
| 17 |
-
## **Instruct format
|
| 18 |
|
| 19 |
* Extended Alpaca (recommended) format, for more information check the main [**base model card here**](https://huggingface.co/Endevor/InfinityRP-v1-7B#style-details).
|
| 20 |
|
| 21 |
* The expected --contextsize this model can handle is **8192**.
|
| 22 |
|
|
|
|
|
|
|
| 23 |
**What does "Imatrix" mean?**
|
| 24 |
|
| 25 |
It stands for **Importance Matrix**, a technique used to improve the quality of quantized models.
|
|
|
|
| 14 |
|
| 15 |
Huge thanks to [@Nitral-AI](https://huggingface.co/Nitral-AI) for merging this one.
|
| 16 |
|
| 17 |
+
## **Instruct format, context size, samplers:**
|
| 18 |
|
| 19 |
* Extended Alpaca (recommended) format, for more information check the main [**base model card here**](https://huggingface.co/Endevor/InfinityRP-v1-7B#style-details).
|
| 20 |
|
| 21 |
* The expected --contextsize this model can handle is **8192**.
|
| 22 |
|
| 23 |
+
* SillyTavern - [TextGen/Samplers](https://files.catbox.moe/6d8dyr.json).
|
| 24 |
+
|
| 25 |
**What does "Imatrix" mean?**
|
| 26 |
|
| 27 |
It stands for **Importance Matrix**, a technique used to improve the quality of quantized models.
|