File size: 312 Bytes
b22b024 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 |
For each component 7b, do Stack A: [0, 28], [12, 32] Stack B: [0, 20], [4, 32] Linear merge: Stack A weight [1, 1, 1, 1, 1, 0.5, 0, 0, 0, 0, 0] Stack B weight [0, 0, 0, 0, 0, 0.5, 1, 1, 1, 1, 1] Final merge: - Toppy stack - Buttocks stack - Westlake stack merge_method: model_stock base_model: Mistral stack |