SpaghettiOs_7B / README.md
jeiku's picture
Upload 10 files
ff0650a verified
|
raw
history blame
2.41 kB
---
base_model:
- Test157t/Pasta-PrimaMaid-7b
- jeiku/Theory_of_Mind_Mistral
- Test157t/Pasta-PrimaMaid-7b
- jeiku/Futadom_Mistral
- Test157t/Pasta-PrimaMaid-7b
- jeiku/Theory_of_Mind_Roleplay_Mistral
- Test157t/Pasta-PrimaMaid-7b
- Test157t/Pasta-PrimaMaid-7b
- jeiku/Humiliation_Mistral
- Test157t/Pasta-PrimaMaid-7b
- jeiku/Gnosis_Reformatted_Mistral
tags:
- mergekit
- merge
---
# Bison
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
## Merge Details
### Merge Method
This model was merged using the [task arithmetic](https://arxiv.org/abs/2212.04089) merge method using [Test157t/Pasta-PrimaMaid-7b](https://huggingface.co/Test157t/Pasta-PrimaMaid-7b) as a base.
### Models Merged
The following models were included in the merge:
* [Test157t/Pasta-PrimaMaid-7b](https://huggingface.co/Test157t/Pasta-PrimaMaid-7b) + [jeiku/Theory_of_Mind_Mistral](https://huggingface.co/jeiku/Theory_of_Mind_Mistral)
* [Test157t/Pasta-PrimaMaid-7b](https://huggingface.co/Test157t/Pasta-PrimaMaid-7b) + [jeiku/Futadom_Mistral](https://huggingface.co/jeiku/Futadom_Mistral)
* [Test157t/Pasta-PrimaMaid-7b](https://huggingface.co/Test157t/Pasta-PrimaMaid-7b) + [jeiku/Theory_of_Mind_Roleplay_Mistral](https://huggingface.co/jeiku/Theory_of_Mind_Roleplay_Mistral)
* [Test157t/Pasta-PrimaMaid-7b](https://huggingface.co/Test157t/Pasta-PrimaMaid-7b) + [jeiku/Humiliation_Mistral](https://huggingface.co/jeiku/Humiliation_Mistral)
* [Test157t/Pasta-PrimaMaid-7b](https://huggingface.co/Test157t/Pasta-PrimaMaid-7b) + [jeiku/Gnosis_Reformatted_Mistral](https://huggingface.co/jeiku/Gnosis_Reformatted_Mistral)
### Configuration
The following YAML configuration was used to produce this model:
```yaml
merge_method: task_arithmetic
base_model: Test157t/Pasta-PrimaMaid-7b
parameters:
normalize: true
models:
- model: Test157t/Pasta-PrimaMaid-7b+jeiku/Theory_of_Mind_Roleplay_Mistral
parameters:
weight: 0.5
- model: Test157t/Pasta-PrimaMaid-7b+jeiku/Theory_of_Mind_Mistral
parameters:
weight: 0.65
- model: Test157t/Pasta-PrimaMaid-7b+jeiku/Gnosis_Reformatted_Mistral
parameters:
weight: 0.75
- model: Test157t/Pasta-PrimaMaid-7b+jeiku/Futadom_Mistral
parameters:
weight: 0.8
- model: Test157t/Pasta-PrimaMaid-7b+jeiku/Humiliation_Mistral
parameters:
weight: 0.6
dtype: float16
```