README.md

---
base_model:
- MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b
- jeiku/Futadom_Mistral
- MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b
- nicce/story-mixtral-8x7b-lora
- MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b
- Triangle104/Vulkane_120-Days-of-Sodom-LoRA-Mistral-7b
- MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b
- jeiku/Sissification_Hypno_Mistral
- MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b
- jspr/llama3-instruct-wordcel-smutrom-8k_peft
- MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b
- vaitech/open-hermes-sd-finetune
- MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b
- jspr/smut_llama_8b_smutromance_32k_peft
- MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b
- vaitech/open-hermes-erotic-story-finetune
- MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b
- jeiku/NSFW_Niche_Mistral
- MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b
- jeiku/Humiliation_Mistral
- MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b
- vincentyandex/lora_llama3_chunked_novel_bs128
- MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b
- fimbulvntr/llewd-8b-64k
- MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b
- jspr/smut_llama_8b_smut_2k_romance_1k_peft
- MrRobotoAI/MrRoboto-ProLong-8b-v4i
library_name: transformers
tags:
- mergekit
- merge

---
# merge

This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).

## Merge Details
### Merge Method

This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [MrRobotoAI/MrRoboto-ProLong-8b-v4i](https://huggingface.co/MrRobotoAI/MrRoboto-ProLong-8b-v4i) as a base.

### Models Merged

The following models were included in the merge:
* [MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b](https://huggingface.co/MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b) + [jeiku/Futadom_Mistral](https://huggingface.co/jeiku/Futadom_Mistral)
* [MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b](https://huggingface.co/MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b) + [nicce/story-mixtral-8x7b-lora](https://huggingface.co/nicce/story-mixtral-8x7b-lora)
* [MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b](https://huggingface.co/MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b) + [Triangle104/Vulkane_120-Days-of-Sodom-LoRA-Mistral-7b](https://huggingface.co/Triangle104/Vulkane_120-Days-of-Sodom-LoRA-Mistral-7b)
* [MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b](https://huggingface.co/MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b) + [jeiku/Sissification_Hypno_Mistral](https://huggingface.co/jeiku/Sissification_Hypno_Mistral)
* [MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b](https://huggingface.co/MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b) + [jspr/llama3-instruct-wordcel-smutrom-8k_peft](https://huggingface.co/jspr/llama3-instruct-wordcel-smutrom-8k_peft)
* [MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b](https://huggingface.co/MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b) + [vaitech/open-hermes-sd-finetune](https://huggingface.co/vaitech/open-hermes-sd-finetune)
* [MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b](https://huggingface.co/MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b) + [jspr/smut_llama_8b_smutromance_32k_peft](https://huggingface.co/jspr/smut_llama_8b_smutromance_32k_peft)
* [MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b](https://huggingface.co/MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b) + [vaitech/open-hermes-erotic-story-finetune](https://huggingface.co/vaitech/open-hermes-erotic-story-finetune)
* [MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b](https://huggingface.co/MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b) + [jeiku/NSFW_Niche_Mistral](https://huggingface.co/jeiku/NSFW_Niche_Mistral)
* [MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b](https://huggingface.co/MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b) + [jeiku/Humiliation_Mistral](https://huggingface.co/jeiku/Humiliation_Mistral)
* [MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b](https://huggingface.co/MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b) + [vincentyandex/lora_llama3_chunked_novel_bs128](https://huggingface.co/vincentyandex/lora_llama3_chunked_novel_bs128)
* [MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b](https://huggingface.co/MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b) + [fimbulvntr/llewd-8b-64k](https://huggingface.co/fimbulvntr/llewd-8b-64k)
* [MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b](https://huggingface.co/MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b) + [jspr/smut_llama_8b_smut_2k_romance_1k_peft](https://huggingface.co/jspr/smut_llama_8b_smut_2k_romance_1k_peft)

### Configuration

The following YAML configuration was used to produce this model:

```yaml
models:

  - model: MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b+jspr/llama3-instruct-wordcel-smutrom-8k_peft
  - model: MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b+jspr/smut_llama_8b_smut_2k_romance_1k_peft
  - model: MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b+jspr/smut_llama_8b_smutromance_32k_peft
  - model: MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b+nicce/story-mixtral-8x7b-lora
  - model: MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b+Triangle104/Vulkane_120-Days-of-Sodom-LoRA-Mistral-7b
  - model: MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b+vaitech/open-hermes-erotic-story-finetune
  - model: MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b+vaitech/open-hermes-sd-finetune
  - model: MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b+vincentyandex/lora_llama3_chunked_novel_bs128
  - model: MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b+jeiku/Futadom_Mistral
  - model: MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b+jeiku/Humiliation_Mistral
  - model: MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b+jeiku/NSFW_Niche_Mistral
  - model: MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b+jeiku/Sissification_Hypno_Mistral
  - model: MrRobotoAI/MrRoboto-ProLongBASE-pt2-unaligned-8b+fimbulvntr/llewd-8b-64k

merge_method: model_stock
base_model: MrRobotoAI/MrRoboto-ProLong-8b-v4i
normalize: true
dtype: float16
```