File size: 672 Bytes
c896bb7 607a68d 9895f8a c896bb7 4dd2542 c896bb7 057da8e c896bb7 057da8e c896bb7 607a68d |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 |
---
base_model: Sao10K/MN-BackyardAI-Party-12B-v1
language:
- en
quantized_by: Lewdiculous
library_name: transformers
license: cc-by-nc-4.0
tags:
- mistral
- arm
- i8mm
- mobile
- roleplay
---
My GGUF-IQ-Imatrix quants for [Sao10K/MN-BackyardAI-Party-12B-v1](https://huggingface.co/Sao10K/MN-BackyardAI-Party-12B-v1).
"For best results, set both `<|im_end|>` and `[INST]` as stopping strings. Recommended Temperature is <1 , min_p of at least 0.1."
> [!NOTE]
> Prompting:
> * Similar to **Mistral** for group chats
> * **ChatML** for one-on-one chats
![image/png](https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/pPih3IO0YQEN8RWZwVlIs.png) |