sirmyrrh commited on
Commit
f6b3bed
·
verified ·
1 Parent(s): d81c033

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +54 -3
README.md CHANGED
@@ -1,3 +1,54 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - TeeZee/Kyllene-34B-v1.1
4
+ - Doctor-Shotgun/Nous-Capybara-limarpv3-34B
5
+ library_name: transformers
6
+ tags:
7
+ - mergekit
8
+ - merge
9
+ license: apache-2.0
10
+ language:
11
+ - en
12
+ ---
13
+ # final_model
14
+
15
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
16
+
17
+ ## Merge Details
18
+ ### Merge Method
19
+
20
+ This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [TeeZee/Kyllene-34B-v1.1](https://huggingface.co/TeeZee/Kyllene-34B-v1.1) as a base.
21
+
22
+ ### Models Merged
23
+
24
+ The following models were included in the merge:
25
+ * [Doctor-Shotgun/Nous-Capybara-limarpv3-34B](https://huggingface.co/Doctor-Shotgun/Nous-Capybara-limarpv3-34B)
26
+
27
+ ### Configuration
28
+
29
+ The following YAML configuration was used to produce this model:
30
+
31
+ ```yaml
32
+ base_model: TeeZee/Kyllene-34B-v1.1
33
+ chat_template: auto
34
+ dtype: float16
35
+ merge_method: ties
36
+ models:
37
+ - model: TeeZee/Kyllene-34B-v1.1
38
+ parameters:
39
+ density: 0.5
40
+ weight: 0.5
41
+ - model: Doctor-Shotgun/Nous-Capybara-limarpv3-34B
42
+ parameters:
43
+ density: 0.5
44
+ weight: 0.5
45
+ parameters:
46
+ int8_mask: true
47
+ normalize: false
48
+
49
+ ```
50
+
51
+
52
+ ---
53
+ license: apache-2.0
54
+ ---