Ashmal commited on
Commit
f372c17
1 Parent(s): 051ab08

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +37 -3
README.md CHANGED
@@ -1,3 +1,37 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: []
3
+ library_name: transformers
4
+ tags:
5
+ - mergekit
6
+ - merge
7
+
8
+ ---
9
+ # cohere_acegpt_selfmerged_12
10
+
11
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
12
+
13
+ ## Merge Details
14
+ ### Merge Method
15
+
16
+ This model was merged using the passthrough merge method.
17
+
18
+ ### Models Merged
19
+
20
+ The following models were included in the merge:
21
+ * /mnt/beegfs/fahad.khan/Arabic_MobiLlama/mergekit/outputs/cohere_acegpt
22
+
23
+ ### Configuration
24
+
25
+ The following YAML configuration was used to produce this model:
26
+
27
+ ```yaml
28
+ slices:
29
+ - sources:
30
+ - layer_range: [0,39]
31
+ model: /mnt/beegfs/fahad.khan/Arabic_MobiLlama/mergekit/outputs/cohere_acegpt
32
+ - sources:
33
+ - layer_range: [51,60]
34
+ model: /mnt/beegfs/fahad.khan/Arabic_MobiLlama/mergekit/outputs/cohere_acegpt
35
+ merge_method: passthrough
36
+ dtype: float16
37
+ ```