adowu commited on
Commit
074dfc3
1 Parent(s): db7f15f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -45
README.md CHANGED
@@ -4,48 +4,8 @@ base_model:
4
  - adowu/a3
5
  - adowu/a1
6
  library_name: transformers
7
- tags:
8
- - mergekit
9
- - merge
10
-
11
- ---
12
- # merge
13
-
14
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
15
-
16
- ## Merge Details
17
- ### Merge Method
18
-
19
- This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [adowu/a2](https://huggingface.co/adowu/a2) as a base.
20
-
21
- ### Models Merged
22
-
23
- The following models were included in the merge:
24
- * [adowu/a3](https://huggingface.co/adowu/a3)
25
- * [adowu/a1](https://huggingface.co/adowu/a1)
26
-
27
- ### Configuration
28
-
29
- The following YAML configuration was used to produce this model:
30
-
31
- ```yaml
32
- models:
33
- - model: adowu/a1
34
- parameters:
35
- density: 1.0
36
- weight: 0.9
37
- - model: adowu/a2
38
- parameters:
39
- density: 1.0
40
- weight: 1.0
41
- - model: adowu/a3
42
- parameters:
43
- density: 1.0
44
- weight: 0.8
45
- merge_method: ties
46
- base_model: adowu/a2
47
- parameters:
48
- normalize: true
49
- int8_mask: true
50
- dtype: bfloat16
51
- ```
 
4
  - adowu/a3
5
  - adowu/a1
6
  library_name: transformers
7
+ license: mit
8
+ language:
9
+ - en
10
+ pipeline_tag: text-generation
11
+ ---