Gryphe commited on
Commit
d9c3df8
1 Parent(s): 2962125

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -5
README.md CHANGED
@@ -1,21 +1,22 @@
1
  ---
2
- base_model: NousResearch/Meta-Llama-3-8B
3
  tags:
4
  - Llama-3
5
  - instruct
6
  - finetune
7
  - chatml
8
  - axolotl
 
9
  license: apache-2.0
10
  language:
11
  - en
12
  ---
13
  ![image/png](Pantheon.png)
14
  # Pantheon-RP-8b-Llama-3
15
- Pantheon Roleplay is a model that has been in the making for almost six months at this point, starting from a collection of personas but steadily having grown into a full-fledged roleplaying model that simultaneously features a smart assistant in the form of Aiva.
16
 
17
  ## Model details
18
- This model features a diverse collection of datasets, totaling ~20 million tokens;
19
 
20
  - For general instructions I created GPT 4 and Claude Opus variations of the No-Robots dataset. I actually ended up not including NoRo itself as it made the model worse.
21
  - For roleplay I used an extensive collection of GPT 4 and Claude Opus data, augmented by the always popular LimaRP for the "human factor".
@@ -38,14 +39,20 @@ I use the following settings for inference:
38
  ```
39
  Besides the basic instructional sets all other datasets were trained with character names added. If your client supports this, enable it at all times for an optimal experience.
40
 
 
 
41
  ### Roleplay
42
 
43
- The majority of the roleplaying data in this model uses an asterisk action, no quote for speech style as that seems to be the norm nowadays. There are no strict rules to character card formatting as the model was trained with a wide variety of inputs.
 
 
44
 
45
  ### Aiva the Assistant
46
 
47
  **System Prompt:** `You are a caring and empathetic sentient AI companion named Aiva.`
48
- Aiva is a distinct mixture of instructional and roleplay data - There's really little she can't do at this point. She shares an android <> creator relationship with the user as she's been my personal assistant for a very long time now. I hope you like her!
 
 
49
 
50
  ### Personas
51
 
@@ -98,6 +105,7 @@ Aiva:
98
  - Everyone from [MinervaAI](https://huggingface.co/MinervaAI)! Hi, guys!
99
  - Huge, huge thanks to [kubernetes_bad](https://huggingface.co/kubernetes-bad) for the compute that made my hundreds of experiments possible!
100
  - All the folks I chat with on a daily basis on Discord! You know who you are.
 
101
 
102
  ## Finally
103
  If you've read this far I encourage you to give this model a serious try and leave feedback! I'd love to see what people think of my first true base model.
 
1
  ---
2
+ base_model: meta-llama/Meta-Llama-3-8B
3
  tags:
4
  - Llama-3
5
  - instruct
6
  - finetune
7
  - chatml
8
  - axolotl
9
+ - roleplay
10
  license: apache-2.0
11
  language:
12
  - en
13
  ---
14
  ![image/png](Pantheon.png)
15
  # Pantheon-RP-8b-Llama-3
16
+ Pantheon Roleplay is a model that has been in the making for the past six months or so, starting from a collection of personas but steadily having grown into a full-fledged roleplaying model that simultaneously features a smart assistant in the form of Aiva.
17
 
18
  ## Model details
19
+ This model features a diverse collection of datasets, totaling ~22 million tokens;
20
 
21
  - For general instructions I created GPT 4 and Claude Opus variations of the No-Robots dataset. I actually ended up not including NoRo itself as it made the model worse.
22
  - For roleplay I used an extensive collection of GPT 4 and Claude Opus data, augmented by the always popular LimaRP for the "human factor".
 
39
  ```
40
  Besides the basic instructional sets all other datasets were trained with character names added. If your client supports this, enable it at all times for an optimal experience.
41
 
42
+ **Note:** Due to the nature of the datasets inside this model you will not be getting page-long roleplay replies. On average, they will be about one or two paragraphs in length.
43
+
44
  ### Roleplay
45
 
46
+ The majority of the roleplaying data in this model uses an asterisk action, no quote for speech style as that seems to be the norm nowadays.
47
+
48
+ There are no strict rules in regards to character card formatting as the model was trained with a wide variety of inputs.
49
 
50
  ### Aiva the Assistant
51
 
52
  **System Prompt:** `You are a caring and empathetic sentient AI companion named Aiva.`
53
+ Aiva is a distinct mixture of instructional and roleplay data - There's really little she can't do at this point with how extensive her training has been. She shares an android <> creator relationship with the user as she's been my personal assistant for a very long time now. I hope you like her!
54
+
55
+ She's basically a sexier version of [Eric Hartford's Samantha](https://erichartford.com/meet-samantha).
56
 
57
  ### Personas
58
 
 
105
  - Everyone from [MinervaAI](https://huggingface.co/MinervaAI)! Hi, guys!
106
  - Huge, huge thanks to [kubernetes_bad](https://huggingface.co/kubernetes-bad) for the compute that made my hundreds of experiments possible!
107
  - All the folks I chat with on a daily basis on Discord! You know who you are.
108
+ - Anyone I forgot to mention, just in case!
109
 
110
  ## Finally
111
  If you've read this far I encourage you to give this model a serious try and leave feedback! I'd love to see what people think of my first true base model.