saishf commited on
Commit
90046bb
1 Parent(s): 61625dd

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +54 -52
README.md CHANGED
@@ -1,52 +1,54 @@
1
- ---
2
- base_model:
3
- - meta-llama/Meta-Llama-3-8B-Instruct
4
- - ResplendentAI/Smarts_Llama3
5
- - meta-llama/Meta-Llama-3-8B-Instruct
6
- - ResplendentAI/Aura_Llama3
7
- - meta-llama/Meta-Llama-3-8B-Instruct
8
- - ResplendentAI/BlueMoon_Llama3
9
- - meta-llama/Meta-Llama-3-8B-Instruct
10
- - ResplendentAI/RP_Format_QuoteAsterisk_Llama3
11
- - meta-llama/Meta-Llama-3-8B-Instruct
12
- - meta-llama/Meta-Llama-3-8B-Instruct
13
- - ResplendentAI/Luna_Llama3
14
- library_name: transformers
15
- tags:
16
- - mergekit
17
- - merge
18
-
19
- ---
20
- # merge
21
-
22
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
23
-
24
- ## Merge Details
25
- ### Merge Method
26
-
27
- This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) as a base.
28
-
29
- ### Models Merged
30
-
31
- The following models were included in the merge:
32
- * [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) + [ResplendentAI/Smarts_Llama3](https://huggingface.co/ResplendentAI/Smarts_Llama3)
33
- * [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) + [ResplendentAI/Aura_Llama3](https://huggingface.co/ResplendentAI/Aura_Llama3)
34
- * [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) + [ResplendentAI/BlueMoon_Llama3](https://huggingface.co/ResplendentAI/BlueMoon_Llama3)
35
- * [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) + [ResplendentAI/RP_Format_QuoteAsterisk_Llama3](https://huggingface.co/ResplendentAI/RP_Format_QuoteAsterisk_Llama3)
36
- * [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) + [ResplendentAI/Luna_Llama3](https://huggingface.co/ResplendentAI/Luna_Llama3)
37
-
38
- ### Configuration
39
-
40
- The following YAML configuration was used to produce this model:
41
-
42
- ```yaml
43
- models:
44
- - model: meta-llama/Meta-Llama-3-8B-Instruct+ResplendentAI/Aura_Llama3
45
- - model: meta-llama/Meta-Llama-3-8B-Instruct+ResplendentAI/Smarts_Llama3
46
- - model: meta-llama/Meta-Llama-3-8B-Instruct+ResplendentAI/Luna_Llama3
47
- - model: meta-llama/Meta-Llama-3-8B-Instruct+ResplendentAI/BlueMoon_Llama3
48
- - model: meta-llama/Meta-Llama-3-8B-Instruct+ResplendentAI/RP_Format_QuoteAsterisk_Llama3
49
- merge_method: model_stock
50
- base_model: meta-llama/Meta-Llama-3-8B-Instruct
51
- dtype: bfloat16
52
- ```
 
 
 
1
+ ---
2
+ license: cc-by-nc-4.0
3
+ base_model:
4
+ - meta-llama/Meta-Llama-3-8B-Instruct
5
+ - ResplendentAI/Smarts_Llama3
6
+ - meta-llama/Meta-Llama-3-8B-Instruct
7
+ - ResplendentAI/Aura_Llama3
8
+ - meta-llama/Meta-Llama-3-8B-Instruct
9
+ - ResplendentAI/BlueMoon_Llama3
10
+ - meta-llama/Meta-Llama-3-8B-Instruct
11
+ - ResplendentAI/RP_Format_QuoteAsterisk_Llama3
12
+ - meta-llama/Meta-Llama-3-8B-Instruct
13
+ - meta-llama/Meta-Llama-3-8B-Instruct
14
+ - ResplendentAI/Luna_Llama3
15
+ library_name: transformers
16
+ tags:
17
+ - mergekit
18
+ - merge
19
+
20
+ ---
21
+ # merge
22
+
23
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
24
+
25
+ ## Merge Details
26
+ Request from [@Virt-io](https://huggingface.co/Virt-io)
27
+ ### Merge Method
28
+
29
+ This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) as a base.
30
+
31
+ ### Models Merged
32
+
33
+ The following models were included in the merge:
34
+ * [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) + [ResplendentAI/Smarts_Llama3](https://huggingface.co/ResplendentAI/Smarts_Llama3)
35
+ * [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) + [ResplendentAI/Aura_Llama3](https://huggingface.co/ResplendentAI/Aura_Llama3)
36
+ * [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) + [ResplendentAI/BlueMoon_Llama3](https://huggingface.co/ResplendentAI/BlueMoon_Llama3)
37
+ * [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) + [ResplendentAI/RP_Format_QuoteAsterisk_Llama3](https://huggingface.co/ResplendentAI/RP_Format_QuoteAsterisk_Llama3)
38
+ * [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) + [ResplendentAI/Luna_Llama3](https://huggingface.co/ResplendentAI/Luna_Llama3)
39
+
40
+ ### Configuration
41
+
42
+ The following YAML configuration was used to produce this model:
43
+
44
+ ```yaml
45
+ models:
46
+ - model: meta-llama/Meta-Llama-3-8B-Instruct+ResplendentAI/Aura_Llama3
47
+ - model: meta-llama/Meta-Llama-3-8B-Instruct+ResplendentAI/Smarts_Llama3
48
+ - model: meta-llama/Meta-Llama-3-8B-Instruct+ResplendentAI/Luna_Llama3
49
+ - model: meta-llama/Meta-Llama-3-8B-Instruct+ResplendentAI/BlueMoon_Llama3
50
+ - model: meta-llama/Meta-Llama-3-8B-Instruct+ResplendentAI/RP_Format_QuoteAsterisk_Llama3
51
+ merge_method: model_stock
52
+ base_model: meta-llama/Meta-Llama-3-8B-Instruct
53
+ dtype: bfloat16
54
+ ```