--- base_model: - akjindal53244/Llama-3.1-Storm-8B - MrRobotoAI/HEL-v0.8-8b-LONG-DARK - nothingiisreal/L3-8B-Stheno-Horny-v3.3-32K - Blackroot/Llama-3-LongStory-LORA - v000000/L3.1-Sthenorm-8B - MrRobotoAI/8b-unaligned-BASE-v2a - MrRobotoAI/Test-v0.9-8b - MrRobotoAI/Thor-v1.4-8b-DARK-FICTION - MrRobotoAI/8b-DARK-unaligned-base - cgato/L3-TheSpice-8b-v0.8.3 - Blackroot/Llama-3-8B-Abomination-LORA - MrRobotoAI/MrRoboto-ProLong-8b-v4i - MrRobotoAI/8b-CHATTY-unaligned-base - DeepAutoAI/ldm_soup_Llama-3.1-8B-Inst - OpenBuddy/openbuddy-llama3.1-8b-v22.2-131k - MrRobotoAI/Loki-v2.8-8b-EROTICA library_name: transformers tags: - mergekit - merge --- # merge This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [MrRobotoAI/MrRoboto-ProLong-8b-v4i](https://huggingface.co/MrRobotoAI/MrRoboto-ProLong-8b-v4i) as a base. ### Models Merged The following models were included in the merge: * [akjindal53244/Llama-3.1-Storm-8B](https://huggingface.co/akjindal53244/Llama-3.1-Storm-8B) * [MrRobotoAI/HEL-v0.8-8b-LONG-DARK](https://huggingface.co/MrRobotoAI/HEL-v0.8-8b-LONG-DARK) * [nothingiisreal/L3-8B-Stheno-Horny-v3.3-32K](https://huggingface.co/nothingiisreal/L3-8B-Stheno-Horny-v3.3-32K) + [Blackroot/Llama-3-LongStory-LORA](https://huggingface.co/Blackroot/Llama-3-LongStory-LORA) * [v000000/L3.1-Sthenorm-8B](https://huggingface.co/v000000/L3.1-Sthenorm-8B) * [MrRobotoAI/8b-unaligned-BASE-v2a](https://huggingface.co/MrRobotoAI/8b-unaligned-BASE-v2a) * [MrRobotoAI/Test-v0.9-8b](https://huggingface.co/MrRobotoAI/Test-v0.9-8b) * [MrRobotoAI/Thor-v1.4-8b-DARK-FICTION](https://huggingface.co/MrRobotoAI/Thor-v1.4-8b-DARK-FICTION) * [MrRobotoAI/8b-DARK-unaligned-base](https://huggingface.co/MrRobotoAI/8b-DARK-unaligned-base) * [cgato/L3-TheSpice-8b-v0.8.3](https://huggingface.co/cgato/L3-TheSpice-8b-v0.8.3) + [Blackroot/Llama-3-8B-Abomination-LORA](https://huggingface.co/Blackroot/Llama-3-8B-Abomination-LORA) * [MrRobotoAI/8b-CHATTY-unaligned-base](https://huggingface.co/MrRobotoAI/8b-CHATTY-unaligned-base) * [DeepAutoAI/ldm_soup_Llama-3.1-8B-Inst](https://huggingface.co/DeepAutoAI/ldm_soup_Llama-3.1-8B-Inst) * [OpenBuddy/openbuddy-llama3.1-8b-v22.2-131k](https://huggingface.co/OpenBuddy/openbuddy-llama3.1-8b-v22.2-131k) * [MrRobotoAI/Loki-v2.8-8b-EROTICA](https://huggingface.co/MrRobotoAI/Loki-v2.8-8b-EROTICA) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: MrRobotoAI/Loki-v2.8-8b-EROTICA - model: MrRobotoAI/Thor-v1.4-8b-DARK-FICTION - model: MrRobotoAI/HEL-v0.8-8b-LONG-DARK - model: MrRobotoAI/Test-v0.9-8b - model: MrRobotoAI/8b-DARK-unaligned-base - model: MrRobotoAI/8b-CHATTY-unaligned-base - model: MrRobotoAI/8b-unaligned-BASE-v2a - model: MrRobotoAI/MrRoboto-ProLong-8b-v4i - model: OpenBuddy/openbuddy-llama3.1-8b-v22.2-131k - model: akjindal53244/Llama-3.1-Storm-8B - model: v000000/L3.1-Sthenorm-8B - model: DeepAutoAI/ldm_soup_Llama-3.1-8B-Inst - model: cgato/L3-TheSpice-8b-v0.8.3+Blackroot/Llama-3-8B-Abomination-LORA - model: nothingiisreal/L3-8B-Stheno-Horny-v3.3-32K+Blackroot/Llama-3-LongStory-LORA merge_method: model_stock base_model: MrRobotoAI/MrRoboto-ProLong-8b-v4i normalize: true dtype: float16 ```