File size: 6,073 Bytes
1eb2416
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
---
base_model:
- MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b
- jeiku/Futadom_Mistral
- MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b
- nicce/story-mixtral-8x7b-lora
- MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b
- Triangle104/Vulkane_120-Days-of-Sodom-LoRA-Mistral-7b
- MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b
- jeiku/Sissification_Hypno_Mistral
- MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b
- jspr/llama3-instruct-wordcel-smutrom-8k_peft
- MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b
- vaitech/open-hermes-sd-finetune
- MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b
- jspr/smut_llama_8b_smutromance_32k_peft
- MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b
- vaitech/open-hermes-erotic-story-finetune
- MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b
- jeiku/NSFW_Niche_Mistral
- MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b
- jeiku/Humiliation_Mistral
- MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b
- vincentyandex/lora_llama3_chunked_novel_bs128
- MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b
- fimbulvntr/llewd-8b-64k
- MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b
- jspr/smut_llama_8b_smut_2k_romance_1k_peft
- MrRobotoAI/MrRoboto-ProLong-8b-v4i
library_name: transformers
tags:
- mergekit
- merge

---
# merge

This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).

## Merge Details
### Merge Method

This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [MrRobotoAI/MrRoboto-ProLong-8b-v4i](https://huggingface.co/MrRobotoAI/MrRoboto-ProLong-8b-v4i) as a base.

### Models Merged

The following models were included in the merge:
* [MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b](https://huggingface.co/MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b) + [jeiku/Futadom_Mistral](https://huggingface.co/jeiku/Futadom_Mistral)
* [MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b](https://huggingface.co/MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b) + [nicce/story-mixtral-8x7b-lora](https://huggingface.co/nicce/story-mixtral-8x7b-lora)
* [MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b](https://huggingface.co/MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b) + [Triangle104/Vulkane_120-Days-of-Sodom-LoRA-Mistral-7b](https://huggingface.co/Triangle104/Vulkane_120-Days-of-Sodom-LoRA-Mistral-7b)
* [MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b](https://huggingface.co/MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b) + [jeiku/Sissification_Hypno_Mistral](https://huggingface.co/jeiku/Sissification_Hypno_Mistral)
* [MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b](https://huggingface.co/MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b) + [jspr/llama3-instruct-wordcel-smutrom-8k_peft](https://huggingface.co/jspr/llama3-instruct-wordcel-smutrom-8k_peft)
* [MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b](https://huggingface.co/MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b) + [vaitech/open-hermes-sd-finetune](https://huggingface.co/vaitech/open-hermes-sd-finetune)
* [MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b](https://huggingface.co/MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b) + [jspr/smut_llama_8b_smutromance_32k_peft](https://huggingface.co/jspr/smut_llama_8b_smutromance_32k_peft)
* [MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b](https://huggingface.co/MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b) + [vaitech/open-hermes-erotic-story-finetune](https://huggingface.co/vaitech/open-hermes-erotic-story-finetune)
* [MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b](https://huggingface.co/MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b) + [jeiku/NSFW_Niche_Mistral](https://huggingface.co/jeiku/NSFW_Niche_Mistral)
* [MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b](https://huggingface.co/MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b) + [jeiku/Humiliation_Mistral](https://huggingface.co/jeiku/Humiliation_Mistral)
* [MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b](https://huggingface.co/MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b) + [vincentyandex/lora_llama3_chunked_novel_bs128](https://huggingface.co/vincentyandex/lora_llama3_chunked_novel_bs128)
* [MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b](https://huggingface.co/MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b) + [fimbulvntr/llewd-8b-64k](https://huggingface.co/fimbulvntr/llewd-8b-64k)
* [MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b](https://huggingface.co/MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b) + [jspr/smut_llama_8b_smut_2k_romance_1k_peft](https://huggingface.co/jspr/smut_llama_8b_smut_2k_romance_1k_peft)

### Configuration

The following YAML configuration was used to produce this model:

```yaml
models:

  - model: MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b+jspr/llama3-instruct-wordcel-smutrom-8k_peft
  - model: MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b+jspr/smut_llama_8b_smut_2k_romance_1k_peft
  - model: MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b+jspr/smut_llama_8b_smutromance_32k_peft
  - model: MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b+nicce/story-mixtral-8x7b-lora
  - model: MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b+Triangle104/Vulkane_120-Days-of-Sodom-LoRA-Mistral-7b
  - model: MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b+vaitech/open-hermes-erotic-story-finetune
  - model: MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b+vaitech/open-hermes-sd-finetune
  - model: MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b+vincentyandex/lora_llama3_chunked_novel_bs128
  - model: MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b+jeiku/Futadom_Mistral
  - model: MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b+jeiku/Humiliation_Mistral
  - model: MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b+jeiku/NSFW_Niche_Mistral
  - model: MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b+jeiku/Sissification_Hypno_Mistral
  - model: MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b+fimbulvntr/llewd-8b-64k

merge_method: model_stock
base_model: MrRobotoAI/MrRoboto-ProLong-8b-v4i
normalize: true
dtype: float16
```