Hugging Face's logo

brucethemoose
/
CaPlatTessDolXaBoros-Yi-34B-200K-DARE-Ties-HighDensity

Text Generation
Transformers
Safetensors
English
llama
text-generation-inference
Merge
Eval Results
Inference Endpoints
Model card Files Community
3
brucethemoose commited on
Commit
f15b214
•
1 Parent(s): ef9c306

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -8
README.md CHANGED
@@ -25,23 +25,23 @@ models:
25
  - model: /home/alpha/Storage/Models/Raw/migtissera_Tess-34B-v1.4
26
  parameters:
27
  weight: 0.19
28
- density: 0.44
29
  - model: /home/alpha//Storage/Models/Raw/bhenrym14_airoboros-3_1-yi-34b-200k
30
  parameters:
31
  weight: 0.14
32
- density: 0.34
33
  - model: /home/alpha/Storage/Models/Raw/Nous-Capybara-34B
34
  parameters:
35
  weight: 0.19
36
- density: 0.44
37
  - model: /home/alpha/Storage/Models/Raw/kyujinpy_PlatYi-34B-200K-Q
38
  parameters:
39
  weight: 0.14
40
- density: 0.34
41
  - model: /home/alpha/FastModels/ehartford_dolphin-2.2-yi-34b-200k
42
  parameters:
43
  weight: 0.19
44
- density: 0.44
45
  - model: /home/alpha/FastModels/fblgit_una-xaberius-34b-v1beta
46
  parameters:
47
  weight: 0.15
@@ -49,10 +49,8 @@ models:
49
  merge_method: dare_ties
50
  base_model: /home/alpha/Storage/Models/Raw/chargoddard_Yi-34B-200K-Llama
51
  parameters:
52
-
53
- int8_mask: true
54
  dtype: bfloat16
55
-
56
  ```
57
  ## Testing Notes
58
 
 
25
  - model: /home/alpha/Storage/Models/Raw/migtissera_Tess-34B-v1.4
26
  parameters:
27
  weight: 0.19
28
+ density: 0.6
29
  - model: /home/alpha//Storage/Models/Raw/bhenrym14_airoboros-3_1-yi-34b-200k
30
  parameters:
31
  weight: 0.14
32
+ density: 0.5
33
  - model: /home/alpha/Storage/Models/Raw/Nous-Capybara-34B
34
  parameters:
35
  weight: 0.19
36
+ density: 0.6
37
  - model: /home/alpha/Storage/Models/Raw/kyujinpy_PlatYi-34B-200K-Q
38
  parameters:
39
  weight: 0.14
40
+ density: 0.5
41
  - model: /home/alpha/FastModels/ehartford_dolphin-2.2-yi-34b-200k
42
  parameters:
43
  weight: 0.19
44
+ density: 0.6
45
  - model: /home/alpha/FastModels/fblgit_una-xaberius-34b-v1beta
46
  parameters:
47
  weight: 0.15
 
49
  merge_method: dare_ties
50
  base_model: /home/alpha/Storage/Models/Raw/chargoddard_Yi-34B-200K-Llama
51
  parameters:
52
+ int8_mask: true
 
53
  dtype: bfloat16
 
54
  ```
55
  ## Testing Notes
56