shadowsword commited on
Commit
6dff80c
1 Parent(s): 01dec4c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +42 -1
README.md CHANGED
@@ -1,3 +1,44 @@
1
  ---
2
- license: other
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ license: llama2
3
+ inference: false
4
+ pipeline_tag: text-generation
5
  ---
6
+
7
+ # GGML's of Pygmalion Vicuna 1.1 7B
8
+ <!-- header start -->
9
+ <div style="width: 100%;">
10
+ <img src="https://huggingface.co/spaces/shadowsword/misc/resolve/main/huggingface_shadowsword_ggml.png" alt="Shadowsword GGML Reuploads" style="width: 100%; min-width: 400px; display: block; margin: auto;">
11
+ </div>
12
+ <!-- header end -->
13
+
14
+ a GGML re-upload by Shadowsword
15
+
16
+ https://huggingface.co/TehVenom/Pygmalion-Vicuna-1.1-7b
17
+
18
+ ggmlv3 from TheBloke's make-ggml.py commit to huggingface repo
19
+
20
+ ```bash
21
+ example$ python3 ./make-ggml.py --model /home/inpw/Pygmalion-1.1-7b --outname Pygmalion-Vicuna-1.1-7b --outdir /home/inpw/Pygmalion-Vicuna-1.1-7b --keep_fp16 --quants ...
22
+ ```
23
+
24
+ Original Card:
25
+
26
+ The LLaMA based Pygmalion-7b model:
27
+
28
+ https://huggingface.co/PygmalionAI/pygmalion-7b
29
+
30
+ Merged alongside lmsys's Vicuna v1.1 deltas:
31
+
32
+ https://huggingface.co/lmsys/vicuna-13b-delta-v1.1
33
+
34
+ This merge was done using an weighted average merge strategy, and the end result is a model composed of:
35
+
36
+ Pygmalion-7b [60%] + LLaMA Vicuna v1.1 [40%]
37
+
38
+
39
+ This was done under request, but the end result is intended to lean heavily towards Pygmalion's chatting + RP tendencies, and to inherit some of Vicuna's Assistant / Instruct / Helpful properties.
40
+
41
+ Due to the influence of Pygmalion, this model will very likely generate content that is considered NSFW.
42
+
43
+ The specific prompting is unknown, but try Pygmalion's prompt styles first,
44
+ then a mix of the two to see what brings most interesting results.