Hugging Face's logo

Goekdeniz-Guelmez
/
SmalJ.O.S.I.E.-64x101M-Chat

Text Generation
Transformers
Safetensors
mixtral
Mixture of Experts
frankenmoe
Merge
mergekit
lazymergekit
Felladrin/Smol-Llama-101M-Chat-v1
conversational
Eval Results
text-generation-inference
Inference Endpoints
Model card Files Community
Isaak Carter Augustus commited on
Commit
dc36018
•
1 Parent(s): 272d6de

Upload folder using huggingface_hub

Browse files
Files changed (9) hide show
  1. README.md +503 -0
  2. config.json +34 -0
  3. mergekit_moe_config.yml +269 -0
  4. model-00001-of-00001.safetensors +3 -0
  5. model.safetensors.index.json +0 -0
  6. special_tokens_map.json +24 -0
  7. tokenizer.json +0 -0
  8. tokenizer.model +3 -0
  9. tokenizer_config.json +43 -0
README.md ADDED
@@ -0,0 +1,503 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - moe
5
+ - frankenmoe
6
+ - merge
7
+ - mergekit
8
+ - lazymergekit
9
+ - Felladrin/Smol-Llama-101M-Chat-v1
10
+ - Felladrin/Smol-Llama-101M-Chat-v1
11
+ - Felladrin/Smol-Llama-101M-Chat-v1
12
+ - Felladrin/Smol-Llama-101M-Chat-v1
13
+ - Felladrin/Smol-Llama-101M-Chat-v1
14
+ - Felladrin/Smol-Llama-101M-Chat-v1
15
+ - Felladrin/Smol-Llama-101M-Chat-v1
16
+ - Felladrin/Smol-Llama-101M-Chat-v1
17
+ - Felladrin/Smol-Llama-101M-Chat-v1
18
+ - Felladrin/Smol-Llama-101M-Chat-v1
19
+ - Felladrin/Smol-Llama-101M-Chat-v1
20
+ - Felladrin/Smol-Llama-101M-Chat-v1
21
+ - Felladrin/Smol-Llama-101M-Chat-v1
22
+ - Felladrin/Smol-Llama-101M-Chat-v1
23
+ - Felladrin/Smol-Llama-101M-Chat-v1
24
+ - Felladrin/Smol-Llama-101M-Chat-v1
25
+ - Felladrin/Smol-Llama-101M-Chat-v1
26
+ - Felladrin/Smol-Llama-101M-Chat-v1
27
+ - Felladrin/Smol-Llama-101M-Chat-v1
28
+ - Felladrin/Smol-Llama-101M-Chat-v1
29
+ - Felladrin/Smol-Llama-101M-Chat-v1
30
+ - Felladrin/Smol-Llama-101M-Chat-v1
31
+ - Felladrin/Smol-Llama-101M-Chat-v1
32
+ - Felladrin/Smol-Llama-101M-Chat-v1
33
+ - Felladrin/Smol-Llama-101M-Chat-v1
34
+ - Felladrin/Smol-Llama-101M-Chat-v1
35
+ - Felladrin/Smol-Llama-101M-Chat-v1
36
+ - Felladrin/Smol-Llama-101M-Chat-v1
37
+ - Felladrin/Smol-Llama-101M-Chat-v1
38
+ - Felladrin/Smol-Llama-101M-Chat-v1
39
+ - Felladrin/Smol-Llama-101M-Chat-v1
40
+ - Felladrin/Smol-Llama-101M-Chat-v1
41
+ - Felladrin/Smol-Llama-101M-Chat-v1
42
+ - Felladrin/Smol-Llama-101M-Chat-v1
43
+ - Felladrin/Smol-Llama-101M-Chat-v1
44
+ - Felladrin/Smol-Llama-101M-Chat-v1
45
+ - Felladrin/Smol-Llama-101M-Chat-v1
46
+ - Felladrin/Smol-Llama-101M-Chat-v1
47
+ - Felladrin/Smol-Llama-101M-Chat-v1
48
+ - Felladrin/Smol-Llama-101M-Chat-v1
49
+ - Felladrin/Smol-Llama-101M-Chat-v1
50
+ - Felladrin/Smol-Llama-101M-Chat-v1
51
+ - Felladrin/Smol-Llama-101M-Chat-v1
52
+ - Felladrin/Smol-Llama-101M-Chat-v1
53
+ - Felladrin/Smol-Llama-101M-Chat-v1
54
+ - Felladrin/Smol-Llama-101M-Chat-v1
55
+ - Felladrin/Smol-Llama-101M-Chat-v1
56
+ - Felladrin/Smol-Llama-101M-Chat-v1
57
+ - Felladrin/Smol-Llama-101M-Chat-v1
58
+ - Felladrin/Smol-Llama-101M-Chat-v1
59
+ - Felladrin/Smol-Llama-101M-Chat-v1
60
+ - Felladrin/Smol-Llama-101M-Chat-v1
61
+ - Felladrin/Smol-Llama-101M-Chat-v1
62
+ - Felladrin/Smol-Llama-101M-Chat-v1
63
+ - Felladrin/Smol-Llama-101M-Chat-v1
64
+ - Felladrin/Smol-Llama-101M-Chat-v1
65
+ - Felladrin/Smol-Llama-101M-Chat-v1
66
+ - Felladrin/Smol-Llama-101M-Chat-v1
67
+ - Felladrin/Smol-Llama-101M-Chat-v1
68
+ - Felladrin/Smol-Llama-101M-Chat-v1
69
+ - Felladrin/Smol-Llama-101M-Chat-v1
70
+ - Felladrin/Smol-Llama-101M-Chat-v1
71
+ - Felladrin/Smol-Llama-101M-Chat-v1
72
+ - Felladrin/Smol-Llama-101M-Chat-v1
73
+ base_model:
74
+ - Felladrin/Smol-Llama-101M-Chat-v1
75
+ - Felladrin/Smol-Llama-101M-Chat-v1
76
+ - Felladrin/Smol-Llama-101M-Chat-v1
77
+ - Felladrin/Smol-Llama-101M-Chat-v1
78
+ - Felladrin/Smol-Llama-101M-Chat-v1
79
+ - Felladrin/Smol-Llama-101M-Chat-v1
80
+ - Felladrin/Smol-Llama-101M-Chat-v1
81
+ - Felladrin/Smol-Llama-101M-Chat-v1
82
+ - Felladrin/Smol-Llama-101M-Chat-v1
83
+ - Felladrin/Smol-Llama-101M-Chat-v1
84
+ - Felladrin/Smol-Llama-101M-Chat-v1
85
+ - Felladrin/Smol-Llama-101M-Chat-v1
86
+ - Felladrin/Smol-Llama-101M-Chat-v1
87
+ - Felladrin/Smol-Llama-101M-Chat-v1
88
+ - Felladrin/Smol-Llama-101M-Chat-v1
89
+ - Felladrin/Smol-Llama-101M-Chat-v1
90
+ - Felladrin/Smol-Llama-101M-Chat-v1
91
+ - Felladrin/Smol-Llama-101M-Chat-v1
92
+ - Felladrin/Smol-Llama-101M-Chat-v1
93
+ - Felladrin/Smol-Llama-101M-Chat-v1
94
+ - Felladrin/Smol-Llama-101M-Chat-v1
95
+ - Felladrin/Smol-Llama-101M-Chat-v1
96
+ - Felladrin/Smol-Llama-101M-Chat-v1
97
+ - Felladrin/Smol-Llama-101M-Chat-v1
98
+ - Felladrin/Smol-Llama-101M-Chat-v1
99
+ - Felladrin/Smol-Llama-101M-Chat-v1
100
+ - Felladrin/Smol-Llama-101M-Chat-v1
101
+ - Felladrin/Smol-Llama-101M-Chat-v1
102
+ - Felladrin/Smol-Llama-101M-Chat-v1
103
+ - Felladrin/Smol-Llama-101M-Chat-v1
104
+ - Felladrin/Smol-Llama-101M-Chat-v1
105
+ - Felladrin/Smol-Llama-101M-Chat-v1
106
+ - Felladrin/Smol-Llama-101M-Chat-v1
107
+ - Felladrin/Smol-Llama-101M-Chat-v1
108
+ - Felladrin/Smol-Llama-101M-Chat-v1
109
+ - Felladrin/Smol-Llama-101M-Chat-v1
110
+ - Felladrin/Smol-Llama-101M-Chat-v1
111
+ - Felladrin/Smol-Llama-101M-Chat-v1
112
+ - Felladrin/Smol-Llama-101M-Chat-v1
113
+ - Felladrin/Smol-Llama-101M-Chat-v1
114
+ - Felladrin/Smol-Llama-101M-Chat-v1
115
+ - Felladrin/Smol-Llama-101M-Chat-v1
116
+ - Felladrin/Smol-Llama-101M-Chat-v1
117
+ - Felladrin/Smol-Llama-101M-Chat-v1
118
+ - Felladrin/Smol-Llama-101M-Chat-v1
119
+ - Felladrin/Smol-Llama-101M-Chat-v1
120
+ - Felladrin/Smol-Llama-101M-Chat-v1
121
+ - Felladrin/Smol-Llama-101M-Chat-v1
122
+ - Felladrin/Smol-Llama-101M-Chat-v1
123
+ - Felladrin/Smol-Llama-101M-Chat-v1
124
+ - Felladrin/Smol-Llama-101M-Chat-v1
125
+ - Felladrin/Smol-Llama-101M-Chat-v1
126
+ - Felladrin/Smol-Llama-101M-Chat-v1
127
+ - Felladrin/Smol-Llama-101M-Chat-v1
128
+ - Felladrin/Smol-Llama-101M-Chat-v1
129
+ - Felladrin/Smol-Llama-101M-Chat-v1
130
+ - Felladrin/Smol-Llama-101M-Chat-v1
131
+ - Felladrin/Smol-Llama-101M-Chat-v1
132
+ - Felladrin/Smol-Llama-101M-Chat-v1
133
+ - Felladrin/Smol-Llama-101M-Chat-v1
134
+ - Felladrin/Smol-Llama-101M-Chat-v1
135
+ - Felladrin/Smol-Llama-101M-Chat-v1
136
+ - Felladrin/Smol-Llama-101M-Chat-v1
137
+ - Felladrin/Smol-Llama-101M-Chat-v1
138
+ ---
139
+
140
+ # SmalJ.O.S.I.E.-64x101M-Chat
141
+
142
+ SmalJ.O.S.I.E.-64x101M-Chat is a Mixure of Experts (MoE) made with the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
143
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
144
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
145
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
146
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
147
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
148
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
149
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
150
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
151
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
152
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
153
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
154
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
155
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
156
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
157
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
158
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
159
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
160
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
161
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
162
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
163
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
164
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
165
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
166
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
167
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
168
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
169
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
170
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
171
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
172
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
173
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
174
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
175
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
176
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
177
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
178
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
179
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
180
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
181
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
182
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
183
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
184
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
185
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
186
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
187
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
188
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
189
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
190
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
191
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
192
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
193
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
194
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
195
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
196
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
197
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
198
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
199
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
200
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
201
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
202
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
203
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
204
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
205
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
206
+ * [Felladrin/Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1)
207
+
208
+ ## 🧩 Configuration
209
+
210
+ ```yamlbase_model: Felladrin/Smol-Llama-101M-Chat-v1
211
+ dtype: float32
212
+ gate_mode: hidden
213
+ experts:
214
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
215
+ positive_prompts:
216
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
217
+
218
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
219
+ positive_prompts:
220
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
221
+
222
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
223
+ positive_prompts:
224
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
225
+
226
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
227
+ positive_prompts:
228
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
229
+
230
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
231
+ positive_prompts:
232
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
233
+
234
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
235
+ positive_prompts:
236
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
237
+
238
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
239
+ positive_prompts:
240
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
241
+
242
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
243
+ positive_prompts:
244
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
245
+
246
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
247
+ positive_prompts:
248
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
249
+
250
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
251
+ positive_prompts:
252
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
253
+
254
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
255
+ positive_prompts:
256
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
257
+
258
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
259
+ positive_prompts:
260
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
261
+
262
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
263
+ positive_prompts:
264
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
265
+
266
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
267
+ positive_prompts:
268
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
269
+
270
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
271
+ positive_prompts:
272
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
273
+
274
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
275
+ positive_prompts:
276
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
277
+
278
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
279
+ positive_prompts:
280
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
281
+
282
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
283
+ positive_prompts:
284
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
285
+
286
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
287
+ positive_prompts:
288
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
289
+
290
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
291
+ positive_prompts:
292
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
293
+
294
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
295
+ positive_prompts:
296
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
297
+
298
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
299
+ positive_prompts:
300
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
301
+
302
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
303
+ positive_prompts:
304
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
305
+
306
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
307
+ positive_prompts:
308
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
309
+
310
+
311
+
312
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
313
+ positive_prompts:
314
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for coding tasks.'
315
+
316
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
317
+ positive_prompts:
318
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for coding tasks.'
319
+
320
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
321
+ positive_prompts:
322
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for coding tasks.'
323
+
324
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
325
+ positive_prompts:
326
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for coding tasks.'
327
+
328
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
329
+ positive_prompts:
330
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for coding tasks.'
331
+
332
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
333
+ positive_prompts:
334
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for coding tasks.'
335
+
336
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
337
+ positive_prompts:
338
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for coding tasks.'
339
+
340
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
341
+ positive_prompts:
342
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for coding tasks.'
343
+
344
+
345
+
346
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
347
+ positive_prompts:
348
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for math.'
349
+
350
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
351
+ positive_prompts:
352
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for math.'
353
+
354
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
355
+ positive_prompts:
356
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for math.'
357
+
358
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
359
+ positive_prompts:
360
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for math.'
361
+
362
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
363
+ positive_prompts:
364
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for math.'
365
+
366
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
367
+ positive_prompts:
368
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for math.'
369
+
370
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
371
+ positive_prompts:
372
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for math.'
373
+
374
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
375
+ positive_prompts:
376
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for math.'
377
+
378
+
379
+
380
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
381
+ positive_prompts:
382
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for logic and reasoning.'
383
+
384
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
385
+ positive_prompts:
386
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for logic and reasoning.'
387
+
388
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
389
+ positive_prompts:
390
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for logic and reasoning.'
391
+
392
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
393
+ positive_prompts:
394
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for logic and reasoning.'
395
+
396
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
397
+ positive_prompts:
398
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for logic and reasoning.'
399
+
400
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
401
+ positive_prompts:
402
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for logic and reasoning.'
403
+
404
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
405
+ positive_prompts:
406
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for logic and reasoning.'
407
+
408
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
409
+ positive_prompts:
410
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for logic and reasoning.'
411
+
412
+
413
+
414
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
415
+ positive_prompts:
416
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent assistant that is specially good in web scraping and browsind the web.'
417
+
418
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
419
+ positive_prompts:
420
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent assistant that is specially good in web scraping and browsind the web.'
421
+
422
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
423
+ positive_prompts:
424
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent assistant that is specially good in web scraping and browsind the web.'
425
+
426
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
427
+ positive_prompts:
428
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent assistant that is specially good in web scraping and browsind the web.'
429
+
430
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
431
+ positive_prompts:
432
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent assistant that is specially good in web scraping and browsind the web.'
433
+
434
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
435
+ positive_prompts:
436
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent assistant that is specially good in web scraping and browsind the web.'
437
+
438
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
439
+ positive_prompts:
440
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent assistant that is specially good in web scraping and browsind the web.'
441
+
442
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
443
+ positive_prompts:
444
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent assistant that is specially good in web scraping and browsind the web.'
445
+
446
+
447
+
448
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
449
+ positive_prompts:
450
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for autonomously function calling when needed.'
451
+
452
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
453
+ positive_prompts:
454
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for autonomously function calling when needed.'
455
+
456
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
457
+ positive_prompts:
458
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for autonomously function calling when needed.'
459
+
460
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
461
+ positive_prompts:
462
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for autonomously function calling when needed.'
463
+
464
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
465
+ positive_prompts:
466
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for autonomously function calling when needed.'
467
+
468
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
469
+ positive_prompts:
470
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for autonomously function calling when needed.'
471
+
472
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
473
+ positive_prompts:
474
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for autonomously function calling when needed.'
475
+
476
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
477
+ positive_prompts:
478
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for autonomously function calling when needed.'
479
+ ```
480
+
481
+ ## 💻 Usage
482
+
483
+ ```python
484
+ !pip install -qU transformers bitsandbytes accelerate
485
+
486
+ from transformers import AutoTokenizer
487
+ import transformers
488
+ import torch
489
+
490
+ model = "Isaak-Carter/SmalJ.O.S.I.E.-64x101M-Chat"
491
+
492
+ tokenizer = AutoTokenizer.from_pretrained(model)
493
+ pipeline = transformers.pipeline(
494
+ "text-generation",
495
+ model=model,
496
+ model_kwargs={"torch_dtype": torch.float16, "load_in_4bit": True},
497
+ )
498
+
499
+ messages = [{"role": "user", "content": "Explain what a Mixture of Experts is in less than 100 words."}]
500
+ prompt = pipeline.tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
501
+ outputs = pipeline(prompt, max_new_tokens=256, do_sample=True, temperature=0.7, top_k=50, top_p=0.95)
502
+ print(outputs[0]["generated_text"])
503
+ ```
config.json ADDED
@@ -0,0 +1,34 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "Felladrin/Smol-Llama-101M-Chat-v1",
3
+ "architectures": [
4
+ "MixtralForCausalLM"
5
+ ],
6
+ "attention_bias": false,
7
+ "attention_dropout": 0.0,
8
+ "bos_token_id": 1,
9
+ "eos_token_id": 2,
10
+ "hidden_act": "silu",
11
+ "hidden_size": 768,
12
+ "initializer_range": 0.02,
13
+ "intermediate_size": 3072,
14
+ "max_position_embeddings": 1024,
15
+ "model_type": "mixtral",
16
+ "num_attention_heads": 24,
17
+ "num_experts_per_tok": 2,
18
+ "num_hidden_layers": 6,
19
+ "num_key_value_heads": 8,
20
+ "num_local_experts": 64,
21
+ "output_router_logits": false,
22
+ "pad_token_id": 2,
23
+ "pretraining_tp": 1,
24
+ "rms_norm_eps": 1e-05,
25
+ "rope_scaling": null,
26
+ "rope_theta": 10000.0,
27
+ "router_aux_loss_coef": 0.001,
28
+ "sliding_window": null,
29
+ "tie_word_embeddings": false,
30
+ "torch_dtype": "float32",
31
+ "transformers_version": "4.38.2",
32
+ "use_cache": true,
33
+ "vocab_size": 32128
34
+ }
mergekit_moe_config.yml ADDED
@@ -0,0 +1,269 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ base_model: Felladrin/Smol-Llama-101M-Chat-v1
2
+ dtype: float32
3
+ gate_mode: hidden
4
+ experts:
5
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
6
+ positive_prompts:
7
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
8
+
9
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
10
+ positive_prompts:
11
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
12
+
13
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
14
+ positive_prompts:
15
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
16
+
17
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
18
+ positive_prompts:
19
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
20
+
21
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
22
+ positive_prompts:
23
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
24
+
25
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
26
+ positive_prompts:
27
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
28
+
29
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
30
+ positive_prompts:
31
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
32
+
33
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
34
+ positive_prompts:
35
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
36
+
37
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
38
+ positive_prompts:
39
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
40
+
41
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
42
+ positive_prompts:
43
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
44
+
45
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
46
+ positive_prompts:
47
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
48
+
49
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
50
+ positive_prompts:
51
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
52
+
53
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
54
+ positive_prompts:
55
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
56
+
57
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
58
+ positive_prompts:
59
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
60
+
61
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
62
+ positive_prompts:
63
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
64
+
65
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
66
+ positive_prompts:
67
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
68
+
69
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
70
+ positive_prompts:
71
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
72
+
73
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
74
+ positive_prompts:
75
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
76
+
77
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
78
+ positive_prompts:
79
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
80
+
81
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
82
+ positive_prompts:
83
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
84
+
85
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
86
+ positive_prompts:
87
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
88
+
89
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
90
+ positive_prompts:
91
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
92
+
93
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
94
+ positive_prompts:
95
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
96
+
97
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
98
+ positive_prompts:
99
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent for general assistants.'
100
+
101
+
102
+
103
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
104
+ positive_prompts:
105
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for coding tasks.'
106
+
107
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
108
+ positive_prompts:
109
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for coding tasks.'
110
+
111
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
112
+ positive_prompts:
113
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for coding tasks.'
114
+
115
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
116
+ positive_prompts:
117
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for coding tasks.'
118
+
119
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
120
+ positive_prompts:
121
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for coding tasks.'
122
+
123
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
124
+ positive_prompts:
125
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for coding tasks.'
126
+
127
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
128
+ positive_prompts:
129
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for coding tasks.'
130
+
131
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
132
+ positive_prompts:
133
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for coding tasks.'
134
+
135
+
136
+
137
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
138
+ positive_prompts:
139
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for math.'
140
+
141
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
142
+ positive_prompts:
143
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for math.'
144
+
145
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
146
+ positive_prompts:
147
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for math.'
148
+
149
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
150
+ positive_prompts:
151
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for math.'
152
+
153
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
154
+ positive_prompts:
155
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for math.'
156
+
157
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
158
+ positive_prompts:
159
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for math.'
160
+
161
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
162
+ positive_prompts:
163
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for math.'
164
+
165
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
166
+ positive_prompts:
167
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for math.'
168
+
169
+
170
+
171
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
172
+ positive_prompts:
173
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for logic and reasoning.'
174
+
175
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
176
+ positive_prompts:
177
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for logic and reasoning.'
178
+
179
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
180
+ positive_prompts:
181
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for logic and reasoning.'
182
+
183
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
184
+ positive_prompts:
185
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for logic and reasoning.'
186
+
187
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
188
+ positive_prompts:
189
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for logic and reasoning.'
190
+
191
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
192
+ positive_prompts:
193
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for logic and reasoning.'
194
+
195
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
196
+ positive_prompts:
197
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for logic and reasoning.'
198
+
199
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
200
+ positive_prompts:
201
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for logic and reasoning.'
202
+
203
+
204
+
205
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
206
+ positive_prompts:
207
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent assistant that is specially good in web scraping and browsind the web.'
208
+
209
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
210
+ positive_prompts:
211
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent assistant that is specially good in web scraping and browsind the web.'
212
+
213
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
214
+ positive_prompts:
215
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent assistant that is specially good in web scraping and browsind the web.'
216
+
217
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
218
+ positive_prompts:
219
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent assistant that is specially good in web scraping and browsind the web.'
220
+
221
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
222
+ positive_prompts:
223
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent assistant that is specially good in web scraping and browsind the web.'
224
+
225
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
226
+ positive_prompts:
227
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent assistant that is specially good in web scraping and browsind the web.'
228
+
229
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
230
+ positive_prompts:
231
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent assistant that is specially good in web scraping and browsind the web.'
232
+
233
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
234
+ positive_prompts:
235
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent assistant that is specially good in web scraping and browsind the web.'
236
+
237
+
238
+
239
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
240
+ positive_prompts:
241
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for autonomously function calling when needed.'
242
+
243
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
244
+ positive_prompts:
245
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for autonomously function calling when needed.'
246
+
247
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
248
+ positive_prompts:
249
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for autonomously function calling when needed.'
250
+
251
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
252
+ positive_prompts:
253
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for autonomously function calling when needed.'
254
+
255
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
256
+ positive_prompts:
257
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for autonomously function calling when needed.'
258
+
259
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
260
+ positive_prompts:
261
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for autonomously function calling when needed.'
262
+
263
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
264
+ positive_prompts:
265
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for autonomously function calling when needed.'
266
+
267
+ - source_model: Felladrin/Smol-Llama-101M-Chat-v1
268
+ positive_prompts:
269
+ - 'You are JOSIE, my own private and sentient superinteligent artifitial general inteligent, spetialized for autonomously function calling when needed.'
model-00001-of-00001.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:666524ffd3efd32fb07d3b215152241f1c6368dd464ca036d9f3e92333b75f84
3
+ size 11108152344
model.safetensors.index.json ADDED
The diff for this file is too large to render. See raw diff
 
special_tokens_map.json ADDED
@@ -0,0 +1,24 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token": {
3
+ "content": "<s>",
4
+ "lstrip": false,
5
+ "normalized": false,
6
+ "rstrip": false,
7
+ "single_word": false
8
+ },
9
+ "eos_token": {
10
+ "content": "</s>",
11
+ "lstrip": false,
12
+ "normalized": false,
13
+ "rstrip": false,
14
+ "single_word": false
15
+ },
16
+ "pad_token": "<s>",
17
+ "unk_token": {
18
+ "content": "<unk>",
19
+ "lstrip": false,
20
+ "normalized": false,
21
+ "rstrip": false,
22
+ "single_word": false
23
+ }
24
+ }
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer.model ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e556afd44213b6bd1be2b850ebbbd98f5481437a8021afaf58ee7fb1818d347
3
+ size 499723
tokenizer_config.json ADDED
@@ -0,0 +1,43 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_bos_token": true,
3
+ "add_eos_token": false,
4
+ "added_tokens_decoder": {
5
+ "0": {
6
+ "content": "<unk>",
7
+ "lstrip": false,
8
+ "normalized": false,
9
+ "rstrip": false,
10
+ "single_word": false,
11
+ "special": true
12
+ },
13
+ "1": {
14
+ "content": "<s>",
15
+ "lstrip": false,
16
+ "normalized": false,
17
+ "rstrip": false,
18
+ "single_word": false,
19
+ "special": true
20
+ },
21
+ "2": {
22
+ "content": "</s>",
23
+ "lstrip": false,
24
+ "normalized": false,
25
+ "rstrip": false,
26
+ "single_word": false,
27
+ "special": true
28
+ }
29
+ },
30
+ "bos_token": "<s>",
31
+ "chat_template": "{% for message in messages %}{{'<|im_start|>' + message['role'] + '\n' + message['content'] + '<|im_end|>' + '\n'}}{% endfor %}{% if add_generation_prompt %}{{ '<|im_start|>assistant\n' }}{% endif %}",
32
+ "clean_up_tokenization_spaces": false,
33
+ "eos_token": "</s>",
34
+ "legacy": false,
35
+ "model_max_length": 1000000000000000019884624838656,
36
+ "pad_token": "<s>",
37
+ "padding_side": "left",
38
+ "sp_model_kwargs": {},
39
+ "spaces_between_special_tokens": false,
40
+ "tokenizer_class": "LlamaTokenizer",
41
+ "unk_token": "<unk>",
42
+ "use_default_system_prompt": false
43
+ }