Aryanne commited on
Commit
42c6339
·
1 Parent(s): 0c6bcd9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -1
README.md CHANGED
@@ -9,4 +9,19 @@ tags:
9
  inference: true
10
  license: cc-by-sa-4.0
11
  ---
12
- This model is a merge/fusion of [PAIXAI/Astrid-3B](https://huggingface.co/PAIXAI/Astrid-3B) and [jondurbin/airoboros-3b-3p0](https://huggingface.co/jondurbin/airoboros-3b-3p0) , 16 layers of each glued together(see astridboros.yml).
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
9
  inference: true
10
  license: cc-by-sa-4.0
11
  ---
12
+ This model is a merge/fusion of [PAIXAI/Astrid-3B](https://huggingface.co/PAIXAI/Astrid-3B) and [jondurbin/airoboros-3b-3p0](https://huggingface.co/jondurbin/airoboros-3b-3p0) , 16 layers of each glued together(see Astridboros.yml or below).
13
+
14
+
15
+ ```yaml
16
+ slices:
17
+ - sources:
18
+ - model: PAIXAI/Astrid-3B
19
+ layer_range: [0, 16]
20
+ - sources:
21
+ - model: jondurbin/airoboros-3b-3p0
22
+ layer_range: [16, 32]
23
+
24
+ merge_method: passthrough
25
+ dtype: float16
26
+ ```
27
+