aipib commited on
Commit
23cec42
1 Parent(s): 4904b9f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -25
README.md CHANGED
@@ -16,31 +16,6 @@ llmjp-dareties is a merge of the following models using [LazyMergekit](https://c
16
  * [kcoopermiller/llm-jp-1.3b-v1.0-aya](https://huggingface.co/kcoopermiller/llm-jp-1.3b-v1.0-aya)
17
  * [llm-jp/llm-jp-1.3b-v1.0](https://huggingface.co/llm-jp/llm-jp-1.3b-v1.0)
18
 
19
- ## 🧩 Configuration
20
-
21
- ```yaml
22
- slices:
23
- - sources:
24
- - layer_range: [0, 24]
25
- model: kcoopermiller/llm-jp-1.3b-v1.0-aya
26
- parameters:
27
- density: [1, 0.7, 0.1]
28
- weight: 1.0
29
- - layer_range: [0, 24]
30
- model: llm-jp/llm-jp-1.3b-v1.0
31
- parameters:
32
- density: 0.33
33
- weight:
34
- - filter: mlp
35
- value: 0.5
36
- - value: 0
37
- merge_method: dare_ties
38
- base_model: llm-jp/llm-jp-1.3b-v1.0
39
- parameters:
40
- normalize: true
41
- int8_mask: true
42
- dtype: bfloat16
43
- ```
44
 
45
  ## 💻 Usage
46
 
 
16
  * [kcoopermiller/llm-jp-1.3b-v1.0-aya](https://huggingface.co/kcoopermiller/llm-jp-1.3b-v1.0-aya)
17
  * [llm-jp/llm-jp-1.3b-v1.0](https://huggingface.co/llm-jp/llm-jp-1.3b-v1.0)
18
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
19
 
20
  ## 💻 Usage
21