ddh0 commited on
Commit
d6c29aa
1 Parent(s): 8d63057

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +31 -0
README.md CHANGED
@@ -2,4 +2,35 @@
2
  license: other
3
  license_name: microsoft-research-license
4
  license_link: https://huggingface.co/microsoft/Orca-2-13b/blob/main/LICENSE
 
5
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2
  license: other
3
  license_name: microsoft-research-license
4
  license_link: https://huggingface.co/microsoft/Orca-2-13b/blob/main/LICENSE
5
+ pipeline_tag: text-generation
6
  ---
7
+
8
+ # OrcaMaid-v3-13b-32k
9
+
10
+ This is the third version of OrcaMaid, a weighted gradient SLERP merge between Microsoft's [Orca-2-13b](https://huggingface.co/microsoft/Orca-2-13b) and NeverSleep's [Noromaid-13b-v0.3](https://huggingface.co/NeverSleep/Noromaid-13b-v0.3).
11
+
12
+ The goal of this merge is to create an unusually intelligent and human-like model especially for RP.
13
+
14
+ The prompt format is Alpaca. You can use the standard format as shown, but for best results, you should customize the system prompt to your specific needs.
15
+
16
+ ```
17
+ Below is an instruction that describes a task. Write a response that appropriately completes the request.
18
+
19
+ ### Instruction:
20
+ {YOUR MESSAGE HERE}
21
+
22
+ ### Response:
23
+ {BOT MESSAGE HERE}
24
+
25
+
26
+ ```
27
+
28
+ ### Misc. information
29
+ - BOS token is `<s>`
30
+ - EOS token is `</s>`
31
+ - Native context length is `32768` via YaRN (original context length was `4096`)
32
+ - Base model is Llama 2
33
+ - Due to the inclusion of Orca-2-13b, the model is subject to the terms of the [Microsoft Research License](https://huggingface.co/microsoft/Orca-2-13b/blob/main/LICENSE)
34
+
35
+ ### Thanks
36
+ - Thanks to [Undi](https://ko-fi.com/undiai) and [IkariDev](https://ikaridevgit.github.io/) of [NeverSleep](https://huggingface.co/NeverSleep) for Noromaid