File size: 1,706 Bytes
b0c6e45
 
 
 
 
 
 
48fd6e0
 
cd5186c
48fd6e0
40cb22e
48fd6e0
 
 
 
 
 
 
 
 
 
 
 
 
cd5186c
40cb22e
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
cd5186c
 
48fd6e0
cd5186c
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
---
license: cc-by-nc-4.0
tags:
- not-for-all-audiences
- nsfw
---

<!-- description start -->
## Description

This repo contains fp16 files of Utopia-13B, a merge I have done with the new task_arithmetic merge method from mergekit.

<!-- description end -->
<!-- description start -->
## Models and loras used

- [Xwin-LM/Xwin-LM-13B-V0.2](https://huggingface.co/Xwin-LM/Xwin-LM-13B-V0.2)
- [NeverSleep/Nethena-13B](https://huggingface.co/NeverSleep/Nethena-13B)
- [PygmalionAI/pygmalion-2-13b](https://huggingface.co/PygmalionAI/pygmalion-2-13b)
- [Undi95/Storytelling-v2.1-13B-lora](https://huggingface.co/Undi95/Storytelling-v2.1-13B-lora)
- [zattio770/120-Days-of-LORA-v2-13B](https://huggingface.co/zattio770/120-Days-of-LORA-v2-13B)
- [lemonilia/LimaRP-Llama2-13B-v3-EXPERIMENT](https://huggingface.co/lemonilia/LimaRP-Llama2-13B-v3-EXPERIMENT)

<!-- description end -->
## The sauce
```
Xwin-LM/Xwin-LM-13B-V0.2
Undi95/Storytelling-v2.1-13B-lora
=> p1

NeverSleep/Nethena-13B
zattio770/120-Days-of-LORA-v2-13B
=> p2

PygmalionAI/pygmalion-2-13b
lemonilia/LimaRP-Llama2-13B-v3-EXPERIMENT
=> p3



merge_method: task_arithmetic
base_model: TheBloke/Llama-2-13B-fp16
models:
  - model: TheBloke/Llama-2-13B-fp16
  - model: Undi95/newpart1
    parameters:
      weight: 1.0
  - model: Undi95/newpart2
    parameters:
      weight: 0.45
  - model: Undi95/newpart3
    parameters:
      weight: 0.33
dtype: float16
```
<!-- prompt-template start -->
## Prompt template: Alpaca

```
Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{prompt}

### Response:

```

If you want to support me, you can [here](https://ko-fi.com/undiai).