louisgrc commited on
Commit
08687a1
1 Parent(s): d4f25ad

Upload folder using huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +35 -0
README.md ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - merge
5
+ - mergekit
6
+ - lazymergekit
7
+ - CultriX/NeuralTrix-bf16
8
+ - AurelPx/Percival_01-7b-slerp
9
+ ---
10
+
11
+ # test
12
+
13
+ test is a merge of the following models using [mergekit](https://github.com/cg123/mergekit):
14
+ * [CultriX/NeuralTrix-bf16](https://huggingface.co/CultriX/NeuralTrix-bf16)
15
+ * [AurelPx/Percival_01-7b-slerp](https://huggingface.co/AurelPx/Percival_01-7b-slerp)
16
+
17
+ ## 🧩 Configuration
18
+
19
+ `yamlslices:
20
+ - sources:
21
+ - model: CultriX/NeuralTrix-bf16
22
+ layer_range: [0, 32]
23
+ - model: AurelPx/Percival_01-7b-slerp
24
+ layer_range: [0, 32]
25
+ merge_method: slerp
26
+ base_model: AurelPx/Percival_01-7b-slerp
27
+ parameters:
28
+ t:
29
+ - filter: self_attn
30
+ value: [0, 0.5, 0.3, 0.7, 1]
31
+ - filter: mlp
32
+ value: [1, 0.5, 0.7, 0.3, 0]
33
+ - value: 0.5
34
+ dtype: float16
35
+ `