Triangle104 commited on
Commit
5a4b038
1 Parent(s): eaada60

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +20 -0
README.md CHANGED
@@ -20,6 +20,26 @@ tags:
20
  This model was converted to GGUF format from [`huihui-ai/Mistral-7B-Instruct-v0.3-abliterated`](https://huggingface.co/huihui-ai/Mistral-7B-Instruct-v0.3-abliterated) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
21
  Refer to the [original model card](https://huggingface.co/huihui-ai/Mistral-7B-Instruct-v0.3-abliterated) for more details on the model.
22
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
23
  ## Use with llama.cpp
24
  Install llama.cpp through brew (works on Mac and Linux)
25
 
 
20
  This model was converted to GGUF format from [`huihui-ai/Mistral-7B-Instruct-v0.3-abliterated`](https://huggingface.co/huihui-ai/Mistral-7B-Instruct-v0.3-abliterated) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
21
  Refer to the [original model card](https://huggingface.co/huihui-ai/Mistral-7B-Instruct-v0.3-abliterated) for more details on the model.
22
 
23
+ ---
24
+ Model details:
25
+ -
26
+ This is an uncensored version of mistralai/Mistral-7B-Instruct-v0.3 created with abliteration (see remove-refusals-with-transformers to know more about it).
27
+
28
+ If the desired result is not achieved, you can clear the conversation and try again.
29
+ Generate with transformers
30
+
31
+ If you want to use Hugging Face transformers to generate text, you can do something like this.
32
+
33
+ from transformers import pipeline
34
+
35
+ messages = [
36
+ {"role": "system", "content": "You are a pirate chatbot who always responds in pirate speak!"},
37
+ {"role": "user", "content": "Who are you?"},
38
+ ]
39
+ chatbot = pipeline("text-generation", model="mistralai/Mistral-7B-Instruct-v0.3-abliterated")
40
+ chatbot(messages)
41
+
42
+ ---
43
  ## Use with llama.cpp
44
  Install llama.cpp through brew (works on Mac and Linux)
45