Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,32 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: cc-by-nc-4.0
|
3 |
+
tags:
|
4 |
+
- not-for-all-audiences
|
5 |
+
- nsfw
|
6 |
+
---
|
7 |
+
|
8 |
+
Mixtral-8x7B-MoE-RP-Story is a model made primarely for chatting, RP (Roleplay) and storywriting.
|
9 |
+
2 RP model, 2 chat model, 1 occult model, 1 storywritting model, 1 mathematic model and 1 DPO model was used for a MoE. Bagel was the base.
|
10 |
+
|
11 |
+
The DPO chat model is here to help get more human reply.
|
12 |
+
|
13 |
+
This is my first try at doing this, so don't hesitate to give feedback!
|
14 |
+
|
15 |
+
<!-- description start -->
|
16 |
+
## Description
|
17 |
+
|
18 |
+
This repo contains quanntized files of Mixtral-8x7B-MoE-RP-Story.
|
19 |
+
|
20 |
+
<!-- description end -->
|
21 |
+
<!-- description start -->
|
22 |
+
## Models used
|
23 |
+
|
24 |
+
The list of model used and their activator/theme can be found [here](https://huggingface.co/Undi95/Mixtral-8x7B-MoE-RP-Story/blob/main/config.yaml)
|
25 |
+
|
26 |
+
<!-- description end -->
|
27 |
+
<!-- prompt-template start -->
|
28 |
+
## Prompt template: Custom
|
29 |
+
|
30 |
+
Using Bagel as a base let us a lot of different prompting system theorically, you can see all the prompting available [here](jondurbin/bagel-7b-v0.1).
|
31 |
+
|
32 |
+
If you want to support me, you can [here](https://ko-fi.com/undiai).
|