nwhamed commited on
Commit
8570537
1 Parent(s): b9d78cb

Upload folder using huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +40 -0
README.md ADDED
@@ -0,0 +1,40 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - merge
5
+ - mergekit
6
+ - lazymergekit
7
+ - yam-peleg/Experiment26-7B
8
+ - chihoonlee10/T3Q-Mistral-Orca-Math-DPO
9
+ ---
10
+
11
+ # trail
12
+
13
+ trail is a merge of the following models using [mergekit](https://github.com/cg123/mergekit):
14
+ * [](https://huggingface.co/)
15
+ * [](https://huggingface.co/)
16
+
17
+ ## 🧩 Configuration
18
+
19
+ ```json{
20
+ "models": [
21
+ {
22
+ "model": "yam-peleg/Experiment26-7B",
23
+ "parameters": {}
24
+ },
25
+ {
26
+ "model": "chihoonlee10/T3Q-Mistral-Orca-Math-DPO",
27
+ "parameters": {
28
+ "density": 0.53,
29
+ "weight": 0.6
30
+ }
31
+ }
32
+ ],
33
+ "merge_method": "dare_ties",
34
+ "base_model": "yam-peleg/Experiment26-7B",
35
+ "parameters": {
36
+ "int8_mask": true,
37
+ "dtype": "bfloat16",
38
+ "random_seed": 0
39
+ }
40
+ }