AlekseiPravdin's picture
Create README.md
a503fbc verified
|
raw
history blame
1.08 kB
---
license: apache-2.0
tags:
- merge
- mergekit
- lazymergekit
- grimjim/kunoichi-lemon-royale-v2-32K-7B
- AlekseiPravdin/Seamaiiza-7B-v1
- Nitral-AI/Nyanade_Stunna-Maid-7B
---
# Seamaiiza-7B-v3-32k
Seamaiiza-7B-v3-32k is a merge of the following models using [mergekit](https://github.com/cg123/mergekit):
* [grimjim/kunoichi-lemon-royale-v2-32K-7B](https://huggingface.co/grimjim/kunoichi-lemon-royale-v2-32K-7B)
* [AlekseiPravdin/Seamaiiza-7B-v1](https://huggingface.co/AlekseiPravdin/Seamaiiza-7B-v1)
* [Nitral-AI/Nyanade_Stunna-Maid-7B](https://huggingface.co/Nitral-AI/Nyanade_Stunna-Maid-7B)
## 🧩 Configuration
```yaml
models:
- model: grimjim/kunoichi-lemon-royale-v2-32K-7B
# no parameters necessary for base model
- model: AlekseiPravdin/Seamaiiza-7B-v1
parameters:
weight: 0.2
density: 0.3
- model: Nitral-AI/Nyanade_Stunna-Maid-7B
parameters:
weight: 0.4
density: 0.5
merge_method: dare_ties
base_model: grimjim/kunoichi-lemon-royale-v2-32K-7B
parameters:
int8_mask: true
normalize: true
dtype: bfloat16
```