File size: 1,356 Bytes
bf6faad e628690 bf6faad e628690 514c8a4 e8d1d38 e628690 6ec972b 514c8a4 6ec972b |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 |
---
license: apache-2.0
tags:
- Solar
- Mistral
- Roleplay
---
### Summary
I did a more aggressive gradient SLERP on the base model with a medical lora added to Frostwind preserving more of the prose model and the prose seemed better without degredation in coherency. So then I redid the dares ties merge of it, with it's parent models, but with a slightly lower weight to FrostWind.
Prose is a bit stronger, coherency slightly weaker with this variant. It's excellent if you are prepared to regen. Really happy with both these models.
### Recipe
Formula for the DARE TIES merge is as follows (FrostMed is Frostwind with Solarmed at 0.15 weight):
- model: ./Frostmaid
parameters:
density: [0.45] # density gradient
weight: 0.23
- model: ./FrostMed
parameters:
density: [0.35] # density gradient
weight: 0.18
- model: ./SnowLotus-10.7B-v2
parameters:
density: [1] # density gradient
weight: 1
Resources used:
https://huggingface.co/BlueNipples/SnowLotus-v2-10.7B
https://huggingface.co/NyxKrage/FrostMaid-10.7B-TESTING-pt
https://huggingface.co/Sao10K/Frostwind-10.7B-v1
https://huggingface.co/NyxKrage/Solar-Doc-10.7B-Lora
https://github.com/cg123/mergekit/tree/main |