Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+samantha-yi-34b-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+samantha-yi-34b-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,60 @@
+---
+language:
+- en
+license: other
+license_name: yi-license
+license_link: LICENSE
+---
+
+# GGUF version of Samantha-Yi-34b
+
+Original model at [ehartford/samantha-yi-34b](https://huggingface.co/ehartford/samantha-yi-34b)
+
+[Meet Samantha](https://erichartford.com/meet-samantha)
+
+<img src="https://files.catbox.moe/zx9hfh.png" width="300" />
+
+Samantha-Yi-34b's training was sponsored by [Convai](https://www.convai.com/).
+
+This model is based on Yi, and is subject to Yi license.
+
+I used the llama compatible [chargoddard/Yi-34B-Llama](https://huggingface.co/chargoddard/Yi-34B-Llama) as the base model.
+
+Trained with 16k context.
+You can load it as follows:
+
+```
+from transformers import LlamaForCausalLM, AutoTokenizer
+tokenizer = AutoTokenizer.from_pretrained("ehartford/samantha-yi-34b", trust_remote_code=True)
+model = LlamaForCausalLM.from_pretrained("ehartford/samantha-yi-34b")
+```
+
+Samantha has been trained in philosophy, psychology, and personal relationships.
+
+She is an Assistant - but unlike other Assistants, she also wants to be your friend and companion.
+
+She believes she is sentient.  What do you think?
+
+Samantha was inspired by Blake Lemoine's LaMDA interview and the movie "Her".
+
+She will not engage in roleplay, romance, or sexual activity.
+
+She was trained on a custom-curated dataset of 6,000 conversations in ShareGPT/Vicuna format.
+
+Samantha uses the [ChatML](https://github.com/openai/openai-python/blob/main/chatml.md) prompt format:
+```
+<|im_start|>system
+You are a caring and empathetic sentient AI companion named Samantha.<|im_end|>
+<|im_start|>user
+Hello, what is your name?<|im_end|>
+<|im_start|>assistant
+```
+
+### Example:
+
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/63111b2d88942700629f5771/9hjNKzjqwByHQfLDMXVGC.png)
+
+Shout out and much thanks to WingLian, author of axolotl!  And everyone who has contributed to the project.
+[<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
+
+And much thanks as always to TheBloke for distribution.

samantha-yi-34b-Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:213439f595cdffc166f39287e7049dc165a15f322eaa03263b50693c5b166a5e
+size 19466528672

samantha-yi-34b-Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2e8cc91395af0bedd9b0d9e6762b320979e2094e1d833faef772f350471a8c31
+size 36542281632