Yash Marathe commited on
Commit
b416e3a
1 Parent(s): a1a089f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -37
README.md CHANGED
@@ -2,51 +2,16 @@
2
  license: apache-2.0
3
  tags:
4
  - merge
5
- - mergekit
6
- - lazymergekit
7
- - openchat/openchat-3.5-0106
8
- - OpenPipe/mistral-ft-optimized-1227
9
- - berkeley-nest/Starling-LM-7B-alpha
10
- - jan-hq/supermario-v2
11
  ---
12
 
13
  # SuperChat-7B
14
 
15
- SuperChat-7B is a merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
16
  * [openchat/openchat-3.5-0106](https://huggingface.co/openchat/openchat-3.5-0106)
17
  * [OpenPipe/mistral-ft-optimized-1227](https://huggingface.co/OpenPipe/mistral-ft-optimized-1227)
18
  * [berkeley-nest/Starling-LM-7B-alpha](https://huggingface.co/berkeley-nest/Starling-LM-7B-alpha)
19
  * [jan-hq/supermario-v2](https://huggingface.co/jan-hq/supermario-v2)
20
 
21
- ## 🧩 Configuration
22
-
23
- ```yaml
24
- base_model: mistralai/Mistral-7B-Instruct-v0.2
25
- dtype: bfloat16
26
- merge_method: dare_ties
27
- models:
28
- - model: mistralai/Mistral-7B-Instruct-v0.2
29
- - model: openchat/openchat-3.5-0106
30
- parameters:
31
- density: 0.8
32
- weight: 0.4
33
- - model: OpenPipe/mistral-ft-optimized-1227
34
- parameters:
35
- density: 0.8
36
- weight: 0.4
37
- - model: berkeley-nest/Starling-LM-7B-alpha
38
- parameters:
39
- density: 0.8
40
- weight: 0.5
41
- - model: jan-hq/supermario-v2
42
- parameters:
43
- density: 0.8
44
- weight: 0.3
45
- parameters:
46
- int8_mask: true
47
-
48
-
49
- ```
50
 
51
  ## 💻 Usage
52
 
@@ -71,4 +36,6 @@ pipeline = transformers.pipeline(
71
 
72
  outputs = pipeline(prompt, max_new_tokens=256, do_sample=True, temperature=0.7, top_k=50, top_p=0.95)
73
  print(outputs[0]["generated_text"])
74
- ```
 
 
 
2
  license: apache-2.0
3
  tags:
4
  - merge
 
 
 
 
 
 
5
  ---
6
 
7
  # SuperChat-7B
8
 
9
+ SuperChat-7B is a merge of the following models:
10
  * [openchat/openchat-3.5-0106](https://huggingface.co/openchat/openchat-3.5-0106)
11
  * [OpenPipe/mistral-ft-optimized-1227](https://huggingface.co/OpenPipe/mistral-ft-optimized-1227)
12
  * [berkeley-nest/Starling-LM-7B-alpha](https://huggingface.co/berkeley-nest/Starling-LM-7B-alpha)
13
  * [jan-hq/supermario-v2](https://huggingface.co/jan-hq/supermario-v2)
14
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
15
 
16
  ## 💻 Usage
17
 
 
36
 
37
  outputs = pipeline(prompt, max_new_tokens=256, do_sample=True, temperature=0.7, top_k=50, top_p=0.95)
38
  print(outputs[0]["generated_text"])
39
+ ```
40
+
41
+ To support my efforts please reach out at maratheyash108@gmail.com