automerger commited on
Commit
2816336
1 Parent(s): 9bf8840

Upload folder using huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +15 -6
README.md CHANGED
@@ -5,22 +5,31 @@ tags:
5
  - mergekit
6
  - lazymergekit
7
  - automerger
 
 
8
  ---
9
 
10
  # LlamaMahou-8B
11
 
12
  LlamaMahou-8B is an automated merge created by [Maxime Labonne](https://huggingface.co/mlabonne) using the following configuration.
 
13
 
14
  ## 🧩 Configuration
15
 
16
  ```yaml
17
  models:
18
- - model: mistralai/Mistral-7B-v0.1
19
- - model: Hastagaras/llama-3-8b-okay
20
- - model: flammenai/Mahou-1.2-llama3-8B
21
- merge_method: model_stock
22
- base_model: mistralai/Mistral-7B-v0.1
23
- dtype: bfloat16
 
 
 
 
 
 
24
  ```
25
 
26
  ## 💻 Usage
 
5
  - mergekit
6
  - lazymergekit
7
  - automerger
8
+ base_model:
9
+ - flammenai/Mahou-1.2-llama3-8B
10
  ---
11
 
12
  # LlamaMahou-8B
13
 
14
  LlamaMahou-8B is an automated merge created by [Maxime Labonne](https://huggingface.co/mlabonne) using the following configuration.
15
+ * [flammenai/Mahou-1.2-llama3-8B](https://huggingface.co/flammenai/Mahou-1.2-llama3-8B)
16
 
17
  ## 🧩 Configuration
18
 
19
  ```yaml
20
  models:
21
+ - model: Hastagaras/llama-3-8b-okay
22
+ # No parameters necessary for base model
23
+ - model: flammenai/Mahou-1.2-llama3-8B
24
+ parameters:
25
+ density: 0.53
26
+ weight: 0.6
27
+ merge_method: dare_ties
28
+ base_model: Hastagaras/llama-3-8b-okay
29
+ parameters:
30
+ int8_mask: true
31
+ dtype: bfloat16
32
+ random_seed: 0
33
  ```
34
 
35
  ## 💻 Usage