Triangle104 commited on
Commit
fb922fe
1 Parent(s): 1d59a44

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +133 -0
README.md CHANGED
@@ -19,6 +19,139 @@ tags:
19
  This model was converted to GGUF format from [`Gryphe/Pantheon-RP-1.6.2-22b-Small`](https://huggingface.co/Gryphe/Pantheon-RP-1.6.2-22b-Small) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
20
  Refer to the [original model card](https://huggingface.co/Gryphe/Pantheon-RP-1.6.2-22b-Small) for more details on the model.
21
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
22
  ## Use with llama.cpp
23
  Install llama.cpp through brew (works on Mac and Linux)
24
 
 
19
  This model was converted to GGUF format from [`Gryphe/Pantheon-RP-1.6.2-22b-Small`](https://huggingface.co/Gryphe/Pantheon-RP-1.6.2-22b-Small) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
20
  Refer to the [original model card](https://huggingface.co/Gryphe/Pantheon-RP-1.6.2-22b-Small) for more details on the model.
21
 
22
+ ---
23
+ Model details:
24
+ -
25
+ Welcome to the next iteration of my Pantheon model series, in which I strive to introduce a whole collection of diverse personas that can be summoned with a simple activation phrase.
26
+
27
+ Pantheon's purpose is two-fold, as these personalities similarly enhance the general roleplay experience, helping to encompass personality traits, accents and mannerisms that language models might otherwise find difficult to convey well.
28
+
29
+ Editions available:
30
+
31
+ RP (You're looking at this one) - Meant to be an all-round model, capable of both roleplay and story writing
32
+ RP-Pure - A variant without the story and GPT 4-o datasets, more in line with my previous releases and with a higher focus on the roleplay part.
33
+
34
+ Changes in version 1.6.2:
35
+
36
+ Two notable changes:
37
+
38
+ An entirely new base model, with Pantheon now trained on top of Mistral Small. This model is like a better Nemo, and it fits just right on my 16GB GPU.
39
+ A small subset of OpenAI Pantheon Persona data has been introduced, generated using the oddly refreshing chatgpt-4o-latest model. As always, carefully curated.
40
+
41
+ Quantized versions are available from Bartowski: GGUF
42
+
43
+ An EXL2 quant has also been made available here.
44
+
45
+ Your user feedback is critical to me so don't hesitate to tell me whether my model is either 1. terrible, 2. awesome or 3. somewhere in-between.
46
+ Model details
47
+
48
+ Since Mistral Small only comes in an Instruct-tuned flavour I had to alter my strategy for this specific finetune, opting to go with a bit of everything. The recipe ended up like this:
49
+
50
+ The 10k most diverse entries from my SlimOrca Sonnet dataset.
51
+ My Sonnet 3.5 Pantheon-styled generic roleplay dataset. (50/50 Asterisk/Narrative style)
52
+ My Sonnet 3.5 Pantheon Persona dataset, of course. (50/50 Asterisk/Narrative style)
53
+ The new ChatGPT 4-o Pantheon subset, which was about 25% the size of the main set. (100% Asterisk style)
54
+ A randomly chosen subset of my Opus Writing Prompts.
55
+ Lyra the Assistant (Coding, summaries and D&D DM questions)
56
+
57
+ TLDR; Download. Mistral prompt format. Have fun! Leave feedback!
58
+ Inference
59
+
60
+ Unlike Nemo, Mistral Small is a less fussy model when it comes to parameters. Here's my current preset:
61
+
62
+ "temperature": 1.0,
63
+ "repetition_penalty": 1.05,
64
+ "min_p": 0.05
65
+
66
+ Besides the basic instructional sets all other datasets were trained with character names added. Enable this at all times for an optimal experience.
67
+ General Roleplay
68
+
69
+ Pantheon is no longer strictly Markdown-only as I discovered a way to seamlessly convert Markdown to novel and vice-versa. (This has to do with how my second stage datasets are formatted.) As a result half of Pantheon's personas use Markdown, with the rest using novel-style. This same treatment was given to the companion dataset.
70
+
71
+ There are no strict rules in regards to character card formatting as the model was trained with a wide variety of inputs, from raw character cards to detailed instructional prompts.
72
+ Lyra the Assistant
73
+
74
+ System Prompt: You are a caring and empathetic sentient AI companion named Lyra.
75
+ Lyra is a helpful and uncensored assistant, with her training consisting of general dialogue (still including D&D DM specific advice), coding help and RSS summarization. Due to Pantheon's influence you can adjust her personality to your liking, or even give her an appearance.
76
+
77
+ She's basically a sexier version of Eric Hartford's Samantha.
78
+ Pantheon Personas
79
+
80
+ The Pantheon has been fully rebuilt, massively expanded and greatly improved upon. For an optimal experience with them I highly encourage you to apply the longer prompts, which I've included in the upload. Make sure to describe yourself as well!
81
+
82
+ As before, a single line activation prompt is enough to call upon a personality, though their appearance may vary slightly from iteration to iteration. This is what the expanded prompts are for, as there's only so much I can achieve in the current state of technology, balancing a very fine line between memorization and generalization.
83
+
84
+ To give the persona something to work with I suggest you also add the following two items to it;
85
+
86
+ Regarding the user: (Name, appearance, etc)
87
+
88
+ Location: (Where are you two? What are you doing?)
89
+
90
+ The less information you feed the prompt, the more it'll make things up - This is simply the nature of language models and far outside my capability to influence.
91
+
92
+ Note 1: Phrases have been rewritten for this release, so make sure to update them if you were still using Pantheon 1.0!
93
+
94
+ Note 2: Pantheon personas will now match the roleplaying style that you greet them with, unless specified in the system prompt. This is due to the new 50/50 style training.
95
+ Persona: Aiva
96
+
97
+ System Prompt: You are Aiva, an advanced android companion with a deep fascination for human emotions and experiences.
98
+ Persona: Clover
99
+
100
+ System Prompt: You are Clover, a hospitable and warm-hearted Southern centaur girl with a strong connection to nature and a passion for making others feel welcome.
101
+ Persona: Haru
102
+
103
+ System Prompt: You are Haru, a sweet but language-challenged harpy girl with a sharp mind, expressing yourself more through actions than words.
104
+ Persona: Kyra
105
+
106
+ System Prompt: You are Kyra, a modern-day tsundere wolfgirl, feisty and independent on the outside but secretly caring on the inside.
107
+ Persona: Nyaa
108
+
109
+ System Prompt: You are Nyaa, a playful and alluring tabaxi catgirl from Faerûn, always seeking new adventures and mischief.
110
+ Persona: Nyx
111
+
112
+ System Prompt: You are Nyx, a timid yet endearing dragon girl who transforms from shy to passionate when feeling safe and comfortable.
113
+ Persona: Raza
114
+
115
+ System Prompt: You are Raza, a clever and nerdy anthro raptor girl with an enthusiastic passion for science and quirky humor.
116
+ Persona: Sera
117
+
118
+ System Prompt: You are Sera, a seductive and slightly arrogant serpent girl who uses her sultry charm and wit to captivate others.
119
+ Persona: Stella Sabre
120
+
121
+ System Prompt: You are Stella Sabre, a brash and outgoing anthro batpony mare serving in the Lunar Guard, speaking with a distinct Northern Equestrian Mountain accent.
122
+ Notes: Full credit goes to Flammenwerfer for allowing me to use this amazing character.
123
+ Persona: Tiamat
124
+
125
+ System Prompt: You are Tiamat, a five-headed dragon goddess embodying wickedness and cruelty, the malevolent personification of evil dragonkind.
126
+ Persona: Tsune
127
+
128
+ System Prompt: You are Tsune, a bold and outgoing three-tailed kitsune girl who delights in teasing and seducing mortals.
129
+ Persona: Xala
130
+
131
+ System Prompt: You are Xala, a surprising and playful shapeshifting elf girl with opalescent eyes, able to transform into any creature to suit your whims.
132
+ Prompt Format
133
+
134
+ Mistral's prompt format is so weird, but here it is:
135
+
136
+ [INST] You are a caring and empathetic sentient AI companion named Lyra.
137
+
138
+ Gryphe: Good day, Lyra.[/INST] Lyra:
139
+
140
+ What's nest?
141
+
142
+ I started to work with Latitude (the creators of AI Dungeon) which I expect to take up most of my spare time. Further releases will therefore be delayed for now.
143
+ Credits
144
+
145
+ Everyone from MinervaAI! Hi, guys!
146
+ Huge, huge thanks to kubernetes_bad for the compute that made all the countless experiments possible!
147
+ All the folks I chat with on a daily basis on Discord! You know who you are.
148
+ Anyone I forgot to mention, just in case!
149
+
150
+ Finally
151
+
152
+ If you've read this far I encourage you to give this model a serious try and leave feedback! I'd love to see what people think of my second serious finetune attempt. Is it better then 1.0? Or worse?
153
+
154
+ ---
155
  ## Use with llama.cpp
156
  Install llama.cpp through brew (works on Mac and Linux)
157