Steelskull commited on
Commit
6cd7c01
·
verified ·
1 Parent(s): 224707f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +119 -22
README.md CHANGED
@@ -9,30 +9,127 @@ tags:
9
  - merge
10
 
11
  ---
12
- # merge
13
-
14
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
15
-
16
- ## Merge Details
17
- ### Merge Method
18
-
19
- This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [CallComply/gemma-2-27b-it](https://huggingface.co/CallComply/gemma-2-27b-it) as a base.
20
-
21
- ### Models Merged
22
-
23
- The following models were included in the merge:
24
- * [TheDrummer/Big-Tiger-Gemma-27B-v1](https://huggingface.co/TheDrummer/Big-Tiger-Gemma-27B-v1)
25
- * [migtissera/Tess-v2.5-Gemma-2-27B-alpha](https://huggingface.co/migtissera/Tess-v2.5-Gemma-2-27B-alpha)
26
-
27
- ### Configuration
28
-
29
- The following YAML configuration was used to produce this model:
30
-
31
- ```yaml
32
- base_model: CallComply/gemma-2-27b-it
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  merge_method: model_stock
34
  dtype: bfloat16
35
  models:
36
  - model: TheDrummer/Big-Tiger-Gemma-27B-v1
37
  - model: migtissera/Tess-v2.5-Gemma-2-27B-alpha
38
- ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
9
  - merge
10
 
11
  ---
12
+ <!DOCTYPE html>
13
+ <html lang="en">
14
+ <head>
15
+ <meta charset="UTF-8">
16
+ <meta name="viewport" content="width=device-width, initial-scale=1.0">
17
+ <title>G2-MS-Nyxora-27b Data Card</title>
18
+ <link href="https://fonts.googleapis.com/css2?family=Quicksand:wght@400;500;600&display=swap" rel="stylesheet">
19
+ <style>
20
+ body, html {
21
+ height: 100%;
22
+ margin: 0;
23
+ padding: 0;
24
+ font-family: 'Quicksand', sans-serif;
25
+ background: linear-gradient(135deg, #0a1128 0%, #1c2541 100%);
26
+ color: #e0e1dd;
27
+ font-size: 16px;
28
+ }
29
+ .container {
30
+ width: 100%;
31
+ height: 100%;
32
+ padding: 20px;
33
+ margin: 0;
34
+ background-color: rgba(255, 255, 255, 0.05);
35
+ border-radius: 12px;
36
+ box-shadow: 0 4px 10px rgba(0, 0, 0, 0.3);
37
+ backdrop-filter: blur(10px);
38
+ border: 1px solid rgba(255, 255, 255, 0.1);
39
+ }
40
+ .header h1 {
41
+ font-size: 28px;
42
+ color: #4cc9f0;
43
+ margin: 0 0 20px 0;
44
+ text-shadow: 2px 2px 4px rgba(0, 0, 0, 0.3);
45
+ }
46
+ .update-section h2 {
47
+ font-size: 24px;
48
+ color: #7209b7;
49
+ }
50
+ .update-section p {
51
+ font-size: 16px;
52
+ line-height: 1.6;
53
+ color: #e0e1dd;
54
+ }
55
+ .info img {
56
+ width: 100%;
57
+ border-radius: 10px;
58
+ margin-bottom: 15px;
59
+ }
60
+ a {
61
+ color: #4cc9f0;
62
+ text-decoration: none;
63
+ }
64
+ a:hover {
65
+ color: #f72585;
66
+ }
67
+ .button {
68
+ display: inline-block;
69
+ background-color: #3a0ca3;
70
+ color: #e0e1dd;
71
+ padding: 10px 20px;
72
+ border-radius: 5px;
73
+ cursor: pointer;
74
+ text-decoration: none;
75
+ }
76
+ .button:hover {
77
+ background-color: #7209b7;
78
+ }
79
+ pre {
80
+ background-color: #1c2541;
81
+ padding: 10px;
82
+ border-radius: 5px;
83
+ overflow-x: auto;
84
+ }
85
+ code {
86
+ font-family: 'Courier New', monospace;
87
+ color: #e0e1dd;
88
+ }
89
+ </style>
90
+ </head>
91
+ <body>
92
+ <div class="container">
93
+ <div class="header">
94
+ <h1>G2-MS-Nyxora-27b</h1>
95
+ </div>
96
+ <div class="info">
97
+ <img src="https://cdn-uploads.huggingface.co/production/uploads/64545af5ec40bbbd01242ca6/rqcAEjzvLpQwu2Cg3g1hH.png" alt="Model Image">
98
+ <p>Now that the cute anime girl has your attention.</p>
99
+ <p><strong>Creator:</strong> <a href="https://huggingface.co/Steelskull" target="_blank">SteelSkull</a></p>
100
+ <h1>About G2-MS-Nyxora-27b:</h1>
101
+ <pre><code><strong>Model Name Legend =</strong>
102
+ "G2 = Gemma 2"
103
+ "MS = Model_stock"</code></pre>
104
+ <p>This model represents an experimental foray into 27b models. Feedback is welcome for further improvements.</p>
105
+ <p>G2-MS-Nyxora-27b combines multiple models' strengths to provide a versatile assistant for various tasks, including general use, storytelling, roleplay, and mature content.</p>
106
+ <p>The Model_stock merge method ensures the model remains focused, tailored, and high-quality.</p>
107
+ <h2>Quants:</h2>
108
+ <p>Will add once found</p>
109
+ <h3>Config:</h3>
110
+ <pre><code>MODEL_NAME = "G2-MS-Nyxora-27b"
111
+ yaml_config = """
112
+ base_model: google/gemma-2-27b-it
113
  merge_method: model_stock
114
  dtype: bfloat16
115
  models:
116
  - model: TheDrummer/Big-Tiger-Gemma-27B-v1
117
  - model: migtissera/Tess-v2.5-Gemma-2-27B-alpha
118
+ """
119
+ </code></pre>
120
+ <h4>Source Model Details:</h4>
121
+ <p><strong>TheDrummer/Big-Tiger-Gemma-27B-v1:</strong><br>
122
+ A decensored version of the Gemma 27B model.
123
+ </p>
124
+ <p><strong>migtissera/Tess-v2.5-Gemma-2-27B-alpha:</strong><br>
125
+ The latest state-of-the-art model in the Tess series, Tess-v2.5.2, offers significant improvements in reasoning, coding, and mathematics. It ranks #1 on the MMLU benchmark among open weight models and outperforms several frontier closed models.
126
+ </p>
127
+ <p><strong>Gemma-2-27b-it:</strong><br>
128
+ A lightweight, state-of-the-art model from Google, well-suited for various text generation tasks. Its small size allows deployment in resource-limited environments, fostering AI innovation for all.
129
+ </p>
130
+ <h4>Merge Method Details:</h4>
131
+ <p>Model_stock Uses some neat geometric properties of fine tuned models to compute good weights for linear interpolation.</p>
132
+ </div>
133
+ </div>
134
+ </body>
135
+ </html>