AlekseiPravdin commited on
Commit
a503fbc
1 Parent(s): 540d302

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +41 -0
README.md ADDED
@@ -0,0 +1,41 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - merge
5
+ - mergekit
6
+ - lazymergekit
7
+ - grimjim/kunoichi-lemon-royale-v2-32K-7B
8
+ - AlekseiPravdin/Seamaiiza-7B-v1
9
+ - Nitral-AI/Nyanade_Stunna-Maid-7B
10
+ ---
11
+
12
+ # Seamaiiza-7B-v3-32k
13
+
14
+ Seamaiiza-7B-v3-32k is a merge of the following models using [mergekit](https://github.com/cg123/mergekit):
15
+
16
+ * [grimjim/kunoichi-lemon-royale-v2-32K-7B](https://huggingface.co/grimjim/kunoichi-lemon-royale-v2-32K-7B)
17
+ * [AlekseiPravdin/Seamaiiza-7B-v1](https://huggingface.co/AlekseiPravdin/Seamaiiza-7B-v1)
18
+ * [Nitral-AI/Nyanade_Stunna-Maid-7B](https://huggingface.co/Nitral-AI/Nyanade_Stunna-Maid-7B)
19
+
20
+ ## 🧩 Configuration
21
+
22
+ ```yaml
23
+ models:
24
+ - model: grimjim/kunoichi-lemon-royale-v2-32K-7B
25
+ # no parameters necessary for base model
26
+ - model: AlekseiPravdin/Seamaiiza-7B-v1
27
+ parameters:
28
+ weight: 0.2
29
+ density: 0.3
30
+ - model: Nitral-AI/Nyanade_Stunna-Maid-7B
31
+ parameters:
32
+ weight: 0.4
33
+ density: 0.5
34
+ merge_method: dare_ties
35
+ base_model: grimjim/kunoichi-lemon-royale-v2-32K-7B
36
+ parameters:
37
+ int8_mask: true
38
+ normalize: true
39
+ dtype: bfloat16
40
+
41
+ ```