Update README.md
Browse files
README.md
CHANGED
|
@@ -8,9 +8,11 @@ license: cc-by-nc-4.0
|
|
| 8 |
---
|
| 9 |
My GGUF-IQ-Imatrix quants for [Sao10K/MN-BackyardAI-Party-12B-v1](https://huggingface.co/Sao10K/MN-BackyardAI-Party-12B-v1).
|
| 10 |
|
|
|
|
|
|
|
| 11 |
> [!NOTE]
|
| 12 |
> Prompting:
|
| 13 |
-
> * **Mistral** for group chats
|
| 14 |
> * **ChatML** for one-on-one chats
|
| 15 |
|
| 16 |
|
|
|
|
| 8 |
---
|
| 9 |
My GGUF-IQ-Imatrix quants for [Sao10K/MN-BackyardAI-Party-12B-v1](https://huggingface.co/Sao10K/MN-BackyardAI-Party-12B-v1).
|
| 10 |
|
| 11 |
+
"For best results, set both `<|im_end|>` and `[INST]` as stopping strings. Recommended Temperature is <1 , min_p of at least 0.1."
|
| 12 |
+
|
| 13 |
> [!NOTE]
|
| 14 |
> Prompting:
|
| 15 |
+
> * Similar to **Mistral** for group chats
|
| 16 |
> * **ChatML** for one-on-one chats
|
| 17 |
|
| 18 |
|