Update README.md
Browse files
README.md
CHANGED
@@ -124,8 +124,8 @@ This model was merged using the SLERP merge method.
|
|
124 |
### Models Merged
|
125 |
|
126 |
The following models were included in the merge:
|
127 |
-
*
|
128 |
-
*
|
129 |
|
130 |
### Configuration
|
131 |
|
@@ -134,13 +134,13 @@ The following YAML configuration was used to produce this model:
|
|
134 |
```yaml
|
135 |
slices:
|
136 |
- sources:
|
137 |
-
- model:
|
138 |
layer_range: [0, 32]
|
139 |
-
- model:
|
140 |
layer_range: [0, 32]
|
141 |
|
142 |
merge_method: slerp
|
143 |
-
base_model:
|
144 |
parameters:
|
145 |
t:
|
146 |
- filter: self_attn
|
|
|
124 |
### Models Merged
|
125 |
|
126 |
The following models were included in the merge:
|
127 |
+
* IceLatteRP
|
128 |
+
* IceMochaccinoRP-7b
|
129 |
|
130 |
### Configuration
|
131 |
|
|
|
134 |
```yaml
|
135 |
slices:
|
136 |
- sources:
|
137 |
+
- model: IceMochaccinoRP-7b
|
138 |
layer_range: [0, 32]
|
139 |
+
- model: IceLatteRP
|
140 |
layer_range: [0, 32]
|
141 |
|
142 |
merge_method: slerp
|
143 |
+
base_model: IceLatteRP
|
144 |
parameters:
|
145 |
t:
|
146 |
- filter: self_attn
|