Lewdiculous
/

MN-BackyardAI-Party-12B-v1-GGUF-IQ-ARM-Imatrix

Inference Endpoints

Model card Files Files and versions Community

Lewdiculous commited on Oct 2, 2024

Commit

607a68d

·

verified ·

1 Parent(s): 61c4e66

tags

Files changed (1) hide show

README.md +6 -1

README.md CHANGED Viewed

@@ -5,6 +5,11 @@ language:
 quantized_by: Lewdiculous
 library_name: transformers
 license: cc-by-nc-4.0
 ---
 My GGUF-IQ-Imatrix quants for [Sao10K/MN-BackyardAI-Party-12B-v1](https://huggingface.co/Sao10K/MN-BackyardAI-Party-12B-v1).
@@ -15,4 +20,4 @@ My GGUF-IQ-Imatrix quants for [Sao10K/MN-BackyardAI-Party-12B-v1](https://huggin
 > * Similar to **Mistral** for group chats
 > * **ChatML** for one-on-one chats
-![image/png](https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/pPih3IO0YQEN8RWZwVlIs.png)

 quantized_by: Lewdiculous
 library_name: transformers
 license: cc-by-nc-4.0
+tags:
+- mistral
+- arm
+- i8mm
+- mobile
 ---
 My GGUF-IQ-Imatrix quants for [Sao10K/MN-BackyardAI-Party-12B-v1](https://huggingface.co/Sao10K/MN-BackyardAI-Party-12B-v1).
 > * Similar to **Mistral** for group chats
 > * **ChatML** for one-on-one chats
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/pPih3IO0YQEN8RWZwVlIs.png)