MarsupialAI commited on
Commit
b22b024
1 Parent(s): cb66f13

Upload recipe.txt

Browse files
Files changed (1) hide show
  1. recipe.txt +14 -0
recipe.txt ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ For each component 7b, do
2
+
3
+ Stack A: [0, 28], [12, 32]
4
+ Stack B: [0, 20], [4, 32]
5
+ Linear merge:
6
+ Stack A weight [1, 1, 1, 1, 1, 0.5, 0, 0, 0, 0, 0]
7
+ Stack B weight [0, 0, 0, 0, 0, 0.5, 1, 1, 1, 1, 1]
8
+
9
+ Final merge:
10
+ - Toppy stack
11
+ - Buttocks stack
12
+ - Westlake stack
13
+ merge_method: model_stock
14
+ base_model: Mistral stack