Lewdiculous's picture
Update README.md
057da8e verified
|
raw
history blame
624 Bytes
metadata
base_model: Sao10K/MN-BackyardAI-Party-12B-v1
language:
  - en
quantized_by: Lewdiculous
library_name: transformers
license: cc-by-nc-4.0

My GGUF-IQ-Imatrix quants for Sao10K/MN-BackyardAI-Party-12B-v1.

"For best results, set both <|im_end|> and [INST] as stopping strings. Recommended Temperature is <1 , min_p of at least 0.1."

Prompting:

  • Similar to Mistral for group chats
  • ChatML for one-on-one chats

image/png