Triangle104 commited on
Commit
5002e34
·
verified ·
1 Parent(s): 27f7868

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +56 -1
README.md CHANGED
@@ -6,12 +6,67 @@ tags:
6
  - merge
7
  - llama-cpp
8
  - gguf-my-repo
 
9
  ---
10
 
11
  # Triangle104/Yomiel-22B-Q4_K_M-GGUF
12
  This model was converted to GGUF format from [`Silvelter/Yomiel-22B`](https://huggingface.co/Silvelter/Yomiel-22B) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
13
  Refer to the [original model card](https://huggingface.co/Silvelter/Yomiel-22B) for more details on the model.
14
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
15
  ## Use with llama.cpp
16
  Install llama.cpp through brew (works on Mac and Linux)
17
 
@@ -50,4 +105,4 @@ Step 3: Run inference through the main binary.
50
  or
51
  ```
52
  ./llama-server --hf-repo Triangle104/Yomiel-22B-Q4_K_M-GGUF --hf-file yomiel-22b-q4_k_m.gguf -c 2048
53
- ```
 
6
  - merge
7
  - llama-cpp
8
  - gguf-my-repo
9
+ license: apache-2.0
10
  ---
11
 
12
  # Triangle104/Yomiel-22B-Q4_K_M-GGUF
13
  This model was converted to GGUF format from [`Silvelter/Yomiel-22B`](https://huggingface.co/Silvelter/Yomiel-22B) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
14
  Refer to the [original model card](https://huggingface.co/Silvelter/Yomiel-22B) for more details on the model.
15
 
16
+ ---
17
+ Model details:
18
+ -
19
+ This is a merge of pre-trained language models created using mergekit.
20
+
21
+ Merge Method
22
+ -
23
+ This model was merged using the della_linear merge method using ArliAI/Mistral-Small-22B-ArliAI-RPMax-v1.1 as a base.
24
+ Models Merged
25
+
26
+ The following models were included in the merge:
27
+
28
+ nbeerbower/Mistral-Small-Drummer-22B
29
+ gghfez/SeminalRP-22b
30
+ TheDrummer/Cydonia-22B-v1.1
31
+ anthracite-org/magnum-v4-22b
32
+
33
+ Configuration
34
+ -
35
+ The following YAML configuration was used to produce this model:
36
+
37
+ base_model: ArliAI/Mistral-Small-22B-ArliAI-RPMax-v1.1
38
+ parameters:
39
+ epsilon: 0.04
40
+ lambda: 1.05
41
+ int8_mask: true
42
+ rescale: true
43
+ normalize: false
44
+ dtype: bfloat16
45
+ tokenizer_source: base
46
+ merge_method: della_linear
47
+ models:
48
+ - model: ArliAI/Mistral-Small-22B-ArliAI-RPMax-v1.1
49
+ parameters:
50
+ weight: [0.2, 0.3, 0.2, 0.3, 0.2]
51
+ density: [0.45, 0.55, 0.45, 0.55, 0.45]
52
+ - model: gghfez/SeminalRP-22b
53
+ parameters:
54
+ weight: [0.01768, -0.01675, 0.01285, -0.01696, 0.01421]
55
+ density: [0.6, 0.4, 0.5, 0.4, 0.6]
56
+ - model: anthracite-org/magnum-v4-22b
57
+ parameters:
58
+ weight: [0.208, 0.139, 0.139, 0.139, 0.208]
59
+ density: [0.7]
60
+ - model: TheDrummer/Cydonia-22B-v1.1
61
+ parameters:
62
+ weight: [0.208, 0.139, 0.139, 0.139, 0.208]
63
+ density: [0.7]
64
+ - model: nbeerbower/Mistral-Small-Drummer-22B
65
+ parameters:
66
+ weight: [0.33]
67
+ density: [0.45, 0.55, 0.45, 0.55, 0.45]
68
+
69
+ ---
70
  ## Use with llama.cpp
71
  Install llama.cpp through brew (works on Mac and Linux)
72
 
 
105
  or
106
  ```
107
  ./llama-server --hf-repo Triangle104/Yomiel-22B-Q4_K_M-GGUF --hf-file yomiel-22b-q4_k_m.gguf -c 2048
108
+ ```