BahaaEldin0 commited on
Commit
767f62b
·
verified ·
1 Parent(s): 9ea532b

Upload folder using huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +31 -0
README.md ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - merge
5
+ - mergekit
6
+ - lazymergekit
7
+ - mistralai/Mistral-7B-Instruct-v0.1
8
+ ---
9
+
10
+ # Marcoro14-7B-slerp
11
+
12
+ Marcoro14-7B-slerp is a merge of the following models using [mergekit](https://github.com/cg123/mergekit):
13
+ * [mistralai/Mistral-7B-Instruct-v0.1](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1)
14
+
15
+ ## 🧩 Configuration
16
+
17
+ ```yaml
18
+ models:
19
+ - model: meta-llama/Meta-Llama-3-8B
20
+ # no parameters necessary for base model
21
+ - model: mistralai/Mistral-7B-Instruct-v0.1
22
+ parameters:
23
+ density: 0.5
24
+ weight: 0.5
25
+ merge_method: ties
26
+ base_model: meta-llama/Meta-Llama-3-8B
27
+ parameters:
28
+ normalize: true
29
+ dtype: float16
30
+
31
+ ```