Update README.md
Browse files
README.md
CHANGED
@@ -39,7 +39,7 @@ Semi-Healed Llama-3 15B Frankenmerge
|
|
39 |
|
40 |
This is the third iteration "Emerald" of the final four and the one I liked the most. It has had limited testing though, but seems relatively decent. Better than 8B at least.
|
41 |
|
42 |
-
Findings: o_proj and down_proj can be stolen from Aethora-v2 so new 15B frankenmerges don't seem to really ***need*** finetuning to "heal" the layers, though it has a big influence on the output so it's slightly censored.
|
43 |
|
44 |
# <h1>merge</h1>
|
45 |
|
|
|
39 |
|
40 |
This is the third iteration "Emerald" of the final four and the one I liked the most. It has had limited testing though, but seems relatively decent. Better than 8B at least.
|
41 |
|
42 |
+
Findings: o_proj and down_proj can be stolen from Aethora-v2 so new 15B frankenmerges don't seem to really ***need*** finetuning to "heal" the layers, though it has a big influence on the output so it's slightly censored in one-shot.
|
43 |
|
44 |
# <h1>merge</h1>
|
45 |
|