Update README.md
Browse files
README.md
CHANGED
@@ -2,4 +2,35 @@
|
|
2 |
license: other
|
3 |
license_name: microsoft-research-license
|
4 |
license_link: https://huggingface.co/microsoft/Orca-2-13b/blob/main/LICENSE
|
|
|
5 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2 |
license: other
|
3 |
license_name: microsoft-research-license
|
4 |
license_link: https://huggingface.co/microsoft/Orca-2-13b/blob/main/LICENSE
|
5 |
+
pipeline_tag: text-generation
|
6 |
---
|
7 |
+
|
8 |
+
# OrcaMaid-v3-13b-32k
|
9 |
+
|
10 |
+
This is the third version of OrcaMaid, a weighted gradient SLERP merge between Microsoft's [Orca-2-13b](https://huggingface.co/microsoft/Orca-2-13b) and NeverSleep's [Noromaid-13b-v0.3](https://huggingface.co/NeverSleep/Noromaid-13b-v0.3).
|
11 |
+
|
12 |
+
The goal of this merge is to create an unusually intelligent and human-like model especially for RP.
|
13 |
+
|
14 |
+
The prompt format is Alpaca. You can use the standard format as shown, but for best results, you should customize the system prompt to your specific needs.
|
15 |
+
|
16 |
+
```
|
17 |
+
Below is an instruction that describes a task. Write a response that appropriately completes the request.
|
18 |
+
|
19 |
+
### Instruction:
|
20 |
+
{YOUR MESSAGE HERE}
|
21 |
+
|
22 |
+
### Response:
|
23 |
+
{BOT MESSAGE HERE}
|
24 |
+
|
25 |
+
|
26 |
+
```
|
27 |
+
|
28 |
+
### Misc. information
|
29 |
+
- BOS token is `<s>`
|
30 |
+
- EOS token is `</s>`
|
31 |
+
- Native context length is `32768` via YaRN (original context length was `4096`)
|
32 |
+
- Base model is Llama 2
|
33 |
+
- Due to the inclusion of Orca-2-13b, the model is subject to the terms of the [Microsoft Research License](https://huggingface.co/microsoft/Orca-2-13b/blob/main/LICENSE)
|
34 |
+
|
35 |
+
### Thanks
|
36 |
+
- Thanks to [Undi](https://ko-fi.com/undiai) and [IkariDev](https://ikaridevgit.github.io/) of [NeverSleep](https://huggingface.co/NeverSleep) for Noromaid
|