Update README.md
Browse files
README.md
CHANGED
@@ -9,4 +9,19 @@ tags:
|
|
9 |
inference: true
|
10 |
license: cc-by-sa-4.0
|
11 |
---
|
12 |
-
This model is a merge/fusion of [PAIXAI/Astrid-3B](https://huggingface.co/PAIXAI/Astrid-3B) and [jondurbin/airoboros-3b-3p0](https://huggingface.co/jondurbin/airoboros-3b-3p0) , 16 layers of each glued together(see
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
9 |
inference: true
|
10 |
license: cc-by-sa-4.0
|
11 |
---
|
12 |
+
This model is a merge/fusion of [PAIXAI/Astrid-3B](https://huggingface.co/PAIXAI/Astrid-3B) and [jondurbin/airoboros-3b-3p0](https://huggingface.co/jondurbin/airoboros-3b-3p0) , 16 layers of each glued together(see Astridboros.yml or below).
|
13 |
+
|
14 |
+
|
15 |
+
```yaml
|
16 |
+
slices:
|
17 |
+
- sources:
|
18 |
+
- model: PAIXAI/Astrid-3B
|
19 |
+
layer_range: [0, 16]
|
20 |
+
- sources:
|
21 |
+
- model: jondurbin/airoboros-3b-3p0
|
22 |
+
layer_range: [16, 32]
|
23 |
+
|
24 |
+
merge_method: passthrough
|
25 |
+
dtype: float16
|
26 |
+
```
|
27 |
+
|