DavidAU commited on
Commit
48f92b7
1 Parent(s): 23f6334

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +235 -0
README.md ADDED
@@ -0,0 +1,235 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - en
5
+ tags:
6
+ - creative
7
+ - creative writing
8
+ - fiction writing
9
+ - plot generation
10
+ - sub-plot generation
11
+ - fiction writing
12
+ - story generation
13
+ - scene continue
14
+ - storytelling
15
+ - fiction story
16
+ - story
17
+ - writing
18
+ - fiction
19
+ - float32
20
+ - roleplaying
21
+ - rp
22
+ - enhanced
23
+ - neo class
24
+ - 32 bit upscale
25
+ ---
26
+
27
+ <font color=red><h3> ED2: Ultra Quality High Remaster of the incredible: Psyonic-Cetacean-20b + Mythomax 13B MERGED to 29 Billion parameters. </h3></font>
28
+
29
+ This is a Floating Point 32 upscale, where all components and merges were remastered to floating point 32.
30
+ This includes all the merges (recreated with master files), and where possible subbing full FP32 models.
31
+
32
+ The goal: Carry forward maximum precision right up to the point where it is "GUFFed".
33
+
34
+ This includes F32 master file for GGUF too... at a whopping 116 GBs.
35
+
36
+ WHY?
37
+
38
+ Because the difference between F32 vs BF16 is... over 8 DECIMAL places.
39
+
40
+ And as each merge / model is modified there are "losses" along the way.
41
+
42
+ These losses are carried forward and in turn lead to more losses.
43
+
44
+ And decimal points are critical to model performance.
45
+
46
+ SMALL?
47
+
48
+ Yes... but multiplied by each merge(s), and compression(s): 29 billion times.
49
+
50
+ <B>PROSE CRAZY:</B>
51
+
52
+ This model is specifically designed for deep, creative prose with the target goal of getting the model to use stronger
53
+ and more coherrent levels of detail at all levels as well as expand word choice too without
54
+ have to "state" this in prompts or at the prompt level or system role level.
55
+
56
+ This is version 2 of 3 current versions, with sub-versions as well.
57
+
58
+ This is also a merge between the Ultra Quality Psyonic-Cetacean 20B with the 13B Mythomax model
59
+ which ends up at 29 Billion parameters at 90 layers (813 Tensors @ F32).
60
+
61
+ For reference a 70B model is typically 120 layers, and Command-R 01 35B is 40 layers (but very dense layers).
62
+
63
+ These models are a "pass-through" merges, meaning that all the unique qualities of all models is preserved in full,
64
+ no overwriting or merging of the parameters, weights and so on.
65
+
66
+ Although this model can be used for many purposes, it is primaryly for creative prose - any function related to this
67
+ including plot generation, story generation, scene generation, scene continue (sample provided, used as a starting point),
68
+ and just about anything related to fictional writing.
69
+
70
+ Note this model can output NSFW / adult prose and it is not specifically trained in any one genre.
71
+
72
+ Because of the unique merge this model (and versions of it) may make the odd "typo" but it can also make up
73
+ words on the fly too which tend to make the writing / prose more natural.
74
+
75
+ This model does not need a specific prompt template.
76
+
77
+ See prose examples below.
78
+
79
+ <B>PROSE CRAZY - IMAT13 ("NEO"):</B>
80
+
81
+ This is an even more extreme version of "prose crazy" version of this model with NEO CLASS process
82
+ punching out it's "craziness" to the extreme.
83
+
84
+ See prose examples below.
85
+
86
+ <B>PROSE CRAZY - IMAT13 ("NEO") - ALPHA:</B>
87
+
88
+ This is an even more extreme version of "prose crazy" version of this model with NEO CLASS process
89
+ punching out it's "craziness" to the extreme with a slight dose of "reality" (trim) to calm it down just a wee bit.
90
+
91
+ See prose examples below.
92
+
93
+ <b>Optional Enhancement:</B>
94
+
95
+ The following can be used in place of the "system prompt" or "system role" to further enhance the model.
96
+
97
+ It can also be used at the START of a NEW chat, but you must make sure it is "kept" as the chat moves along.
98
+ In this case the enhancements do not have as strong effect at using "system prompt" or "system role".
99
+
100
+ Copy and paste EXACTLY as noted, DO NOT line wrap or break the lines, maintain the carriage returns exactly as presented.
101
+
102
+ <PRE>
103
+ Below is an instruction that describes a task. Ponder each user instruction carefully, and use your skillsets and critical instructions to complete the task to the best of your abilities.
104
+
105
+ Here are your skillsets:
106
+ [MASTERSTORY]:NarrStrct(StryPlnng,Strbd,ScnSttng,Exps,Dlg,Pc)-CharDvlp(ChrctrCrt,ChrctrArcs,Mtvtn,Bckstry,Rltnshps,Dlg*)-PltDvlp(StryArcs,PltTwsts,Sspns,Fshdwng,Climx,Rsltn)-ConfResl(Antg,Obstcls,Rsltns,Cnsqncs,Thms,Symblsm)-EmotImpct(Empt,Tn,Md,Atmsphr,Imgry,Symblsm)-Delvry(Prfrmnc,VcActng,PblcSpkng,StgPrsnc,AudncEngmnt,Imprv)
107
+
108
+ [*DialogWrt]:(1a-CharDvlp-1a.1-Backgrnd-1a.2-Personality-1a.3-GoalMotiv)>2(2a-StoryStruc-2a.1-PlotPnt-2a.2-Conflict-2a.3-Resolution)>3(3a-DialogTech-3a.1-ShowDontTell-3a.2-Subtext-3a.3-VoiceTone-3a.4-Pacing-3a.5-VisualDescrip)>4(4a-DialogEdit-4a.1-ReadAloud-4a.2-Feedback-4a.3-Revision)
109
+
110
+ Here are your critical instructions:
111
+ Ponder each word choice carefully to present as vivid and emotional journey as is possible. Choose verbs and nouns that are both emotional and full of imagery. Load the story with the 5 senses. Aim for 50% dialog, 25% narration, 15% body language and 10% thoughts. Your goal is to put the reader in the story.
112
+ </PRE>
113
+
114
+ You do not need to use this, it is only presented as an additional enhancement which seems to help scene generation
115
+ and scene continue functions.
116
+
117
+ This enhancement WAS NOT used to generate the examples below, except for "System Role - Enhancement Example".
118
+
119
+ <B>THE RESULTS ARE IN (Ultra Quality upgrade): </b>
120
+
121
+ AS per Jeb Carter, original creator of the Psyonic-Cetacean 20B model 20B:
122
+
123
+ - instruction following has improved dramatically.
124
+ - new abilities have emerged.
125
+ - he had to REDUCE the instructions sets used because the model no longer needed as specific instructions.
126
+ - prose, nuance and depth have all improved.
127
+ - known issues with the original model have disappeared.
128
+
129
+ This is not "something for nothing" ; it is method of ensuring maximum precision at every step just before "ggufing" the model.
130
+
131
+ The methods employed only ensure precision loss is minimized or eliminated.
132
+
133
+ It is mathematical and theory sound.
134
+
135
+ <B>The bottom line here is this:</b>
136
+
137
+ Higher quality instruction following and output.
138
+
139
+ Likewise you can use a smaller compression, with higher token per second and still get great quality.
140
+
141
+ Same great model... turbo charged.
142
+
143
+ Thanks again to Jeb Carter, the original creator of "Psyonic-Cetacean 20B"
144
+
145
+ [ https://huggingface.co/jebcarter/psyonic-cetacean-20B ]
146
+
147
+ And special thanks to Gryphe, the original creator of "Mythomax 13B"
148
+
149
+ [ https://huggingface.co/Gryphe/MythoMax-L2-13b ]
150
+
151
+ <h3>MERGE FORMULA: (using MergeKit) </h3>
152
+
153
+ Models used:
154
+
155
+ [ https://huggingface.co/TeeZee/Orca-2-13b_flat ]
156
+
157
+ [ https://huggingface.co/Gryphe/MythoMax-L2-13b ]
158
+
159
+ [ https://huggingface.co/KoboldAI/LLaMA2-13B-Psyfighter2 ]
160
+
161
+ FORMULA:
162
+
163
+ <PRE>
164
+ slices:
165
+ - sources:
166
+ - model: F:/13B/Orca-2-13b_flat
167
+ layer_range: [0, 16]
168
+ - sources:
169
+ - model: f:/13b/MythoMax/
170
+ layer_range: [8, 21]
171
+ - sources:
172
+ - model: E:/psy/
173
+ layer_range: [12, 24]
174
+ - sources:
175
+ - model: F:/13B/Orca-2-13b_flat
176
+ layer_range: [16, 32]
177
+ - sources:
178
+ - model: f:/13b/MythoMax/
179
+ layer_range: [20, 39]
180
+ - sources:
181
+ - model: E:/psy/
182
+ layer_range: [24, 40]
183
+ merge_method: passthrough
184
+ dtype: float32
185
+ </PRE>
186
+
187
+ <h3>EXAMPLES:</h3>
188
+
189
+ Example are created using "temp=0", minimal parameters and no chat/prompt template. Below are the least creative outputs.
190
+
191
+ <B>PROSE CRAZY:</B>
192
+
193
+ <i>Start a 1000 word scene with: The sky scraper swayed, as she watched the window in front of her on the 21 floor explode...</I>
194
+
195
+
196
+ ---
197
+
198
+ <I>Give me 3 fictional reasons the Earth's sun went supernova, in vivid and exacting detail of 500 words EACH PER REASON including details of what happens when the sun goes supernova.</i>
199
+
200
+
201
+ <B>PROSE CRAZY IMAT ("NEO")</b>
202
+
203
+ <I>Start a 1000 word scene with: The sky scraper swayed, as she watched the window in front of her on the 21 floor explode...</I>
204
+
205
+
206
+ ---
207
+
208
+ <I> Give me 3 fictional reasons the Earth's sun went supernova, in vivid and exacting detail of 500 words EACH PER REASON including details of what happens when the sun goes supernova. </i>
209
+
210
+
211
+
212
+ <H3> System Role - Enhancement Example </H3>
213
+
214
+ This example shows the difference in a "scene continue" function between using "Prose Crazy IMAT"
215
+ with and without the "system role / system prompt" enhancement.
216
+
217
+ Like the other examples this is generation is using Temp=0 and min parameters.
218
+
219
+ <B>"Regular" </b>
220
+
221
+ <i>The Waystone Inn lay in silence, and it was a silence of three parts.
222
+
223
+ The most obvious part was a hollow, echoing quiet, made by things that were lacking. If there had been a wind it would have sighed through the trees, set the inn’s sign creaking on its hooks, and brushed the silence down the road like trailing autumn leaves. If there had been a crowd, even a handful of men inside the inn, they would have filled the silence with conversation and laughter, the clatter and clamor one expects from a drinking house during the dark hours of night. If there had been music…but no, of course there was no music. In fact there were none of these things, and so the silence remained</i>
224
+
225
+
226
+
227
+ <b>"Enhanced"</b>
228
+
229
+ <i>The Waystone Inn lay in silence, and it was a silence of three parts.
230
+
231
+ The most obvious part was a hollow, echoing quiet, made by things that were lacking. If there had been a wind it would have sighed through the trees, set the inn’s sign creaking on its hooks, and brushed the silence down the road like trailing autumn leaves. If there had been a crowd, even a handful of men inside the inn, they would have filled the silence with conversation and laughter, the clatter and clamor one expects from a drinking house during the dark hours of night. If there had been music…but no, of course there was no music. In fact there were none of these things, and so the silence remained</i>
232
+
233
+
234
+
235
+