BlueNipples
commited on
Commit
•
6ec972b
1
Parent(s):
297f691
Update README.md
Browse files
README.md
CHANGED
@@ -10,4 +10,32 @@ tags:
|
|
10 |
|
11 |
I did a more aggressive gradient SLERP on the base model with a medical lora added to Frostwind preserving more of the prose model and the prose seemed better without degredation in coherency. So then I redid the dares ties merge of it, with it's parent models, but with a slightly lower weight to FrostWind.
|
12 |
|
13 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
10 |
|
11 |
I did a more aggressive gradient SLERP on the base model with a medical lora added to Frostwind preserving more of the prose model and the prose seemed better without degredation in coherency. So then I redid the dares ties merge of it, with it's parent models, but with a slightly lower weight to FrostWind.
|
12 |
|
13 |
+
Prose is a bit stronger, coherency slightly weaker with this variant. It's excellent if you are prepared to regen. Really happy with both these models.
|
14 |
+
|
15 |
+
Formula for the DARE TIES merge is as follows (FrostMed is Frostwind with Solarmed at 0.15 weight):
|
16 |
+
|
17 |
+
- model: ./Frostmaid
|
18 |
+
parameters:
|
19 |
+
density: [0.45] # density gradient
|
20 |
+
weight: 0.23
|
21 |
+
- model: ./FrostMed
|
22 |
+
parameters:
|
23 |
+
density: [0.35] # density gradient
|
24 |
+
weight: 0.18
|
25 |
+
- model: ./SnowLotus-10.7B-v2
|
26 |
+
parameters:
|
27 |
+
density: [1] # density gradient
|
28 |
+
weight: 1
|
29 |
+
|
30 |
+
|
31 |
+
Resources used:
|
32 |
+
|
33 |
+
https://huggingface.co/BlueNipples/SnowLotus-v2-10.7B
|
34 |
+
|
35 |
+
https://huggingface.co/NyxKrage/FrostMaid-10.7B-TESTING-pt
|
36 |
+
|
37 |
+
https://huggingface.co/Sao10K/Frostwind-10.7B-v1
|
38 |
+
|
39 |
+
https://huggingface.co/NyxKrage/Solar-Doc-10.7B-Lora
|
40 |
+
|
41 |
+
https://github.com/cg123/mergekit/tree/main
|