ddeshler commited on
Commit
b825f8f
·
verified ·
1 Parent(s): 0b89843

Upload folder using huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -4,14 +4,14 @@ tags:
4
  - merge
5
  - mergekit
6
  - lazymergekit
7
- - DiscoResearch/mixtral-7b-8expert
8
  - mlabonne/Marcoro14-7B-slerp
9
  ---
10
 
11
  # HerLlama-7B-slerp
12
 
13
  HerLlama-7B-slerp is a merge of the following models using [mergekit](https://github.com/cg123/mergekit):
14
- * [DiscoResearch/mixtral-7b-8expert](https://huggingface.co/DiscoResearch/mixtral-7b-8expert)
15
  * [mlabonne/Marcoro14-7B-slerp](https://huggingface.co/mlabonne/Marcoro14-7B-slerp)
16
 
17
  ## 🧩 Configuration
@@ -19,12 +19,12 @@ HerLlama-7B-slerp is a merge of the following models using [mergekit](https://gi
19
  ```yaml
20
  slices:
21
  - sources:
22
- - model: DiscoResearch/mixtral-7b-8expert
23
  layer_range: [0, 32]
24
  - model: mlabonne/Marcoro14-7B-slerp
25
  layer_range: [0, 32]
26
  merge_method: slerp
27
- base_model: DiscoResearch/mixtral-7b-8expert
28
  parameters:
29
  t:
30
  - filter: self_attn
 
4
  - merge
5
  - mergekit
6
  - lazymergekit
7
+ - HuggingFaceH4/zephyr-7b-alpha
8
  - mlabonne/Marcoro14-7B-slerp
9
  ---
10
 
11
  # HerLlama-7B-slerp
12
 
13
  HerLlama-7B-slerp is a merge of the following models using [mergekit](https://github.com/cg123/mergekit):
14
+ * [HuggingFaceH4/zephyr-7b-alpha](https://huggingface.co/HuggingFaceH4/zephyr-7b-alpha)
15
  * [mlabonne/Marcoro14-7B-slerp](https://huggingface.co/mlabonne/Marcoro14-7B-slerp)
16
 
17
  ## 🧩 Configuration
 
19
  ```yaml
20
  slices:
21
  - sources:
22
+ - model: HuggingFaceH4/zephyr-7b-alpha
23
  layer_range: [0, 32]
24
  - model: mlabonne/Marcoro14-7B-slerp
25
  layer_range: [0, 32]
26
  merge_method: slerp
27
+ base_model: mlabonne/Marcoro14-7B-slerp
28
  parameters:
29
  t:
30
  - filter: self_attn