Undi95 commited on
Commit
b003350
1 Parent(s): a5eb013

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +57 -0
README.md ADDED
@@ -0,0 +1,57 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-4.0
3
+ tags:
4
+ - not-for-all-audiences
5
+ - nsfw
6
+ ---
7
+
8
+ ## MiquMaid v2 2x70B
9
+
10
+ <center>[<a href="https://huggingface.co/NeverSleep/MiquMaid-v2-70B">V2-70B</a> - <a href="https://huggingface.co/NeverSleep/MiquMaid-v2-70B-DPO">V2-70B-DPO</a> - <a href="https://huggingface.co/NeverSleep/MiquMaid-v2-2x70B">V2-2x70B</a> - <a href="https://huggingface.co/NeverSleep/MiquMaid-v2-2x70B-DPO">V2-2x70B-DPO</a>]
11
+ </br>
12
+ <div style="width: 100%;">
13
+ <img src="https://cdn-uploads.huggingface.co/production/uploads/63ab1241ad514ca8d1430003/ro7nbLf4sfRFmFOWcQkUU.png" style="display: block; margin: auto;">
14
+ </div></center>
15
+
16
+ This model uses the Alpaca **prompting format**
17
+
18
+ Model trained for RP conversation on Miqu-70B with our magic sauce.
19
+
20
+ Then, we have done a MoE, made of MiquMaid-v2-70B and Miqu-70B base, making the model using the finetune AND the base model for each token, working together.
21
+
22
+ We have seen a significant improvement, so we decided to share that, even if the model is very big.
23
+
24
+ ## Credits:
25
+ - Undi
26
+ - IkariDev
27
+
28
+ ## Description
29
+
30
+ This repo contains FP16 files of MiquMaid-v2-2x70B.
31
+
32
+ Switch: [FP16](https://huggingface.co/NeverSleep/MiquMaid-v2-2x70B) - [GGUF](https://huggingface.co/NeverSleep/MiquMaid-v2-2x70B-GGUF)
33
+
34
+ ## Training data used:
35
+ - [Aesir datasets](https://huggingface.co/MinervaAI)
36
+ - [NoRobots](https://huggingface.co/datasets/Doctor-Shotgun/no-robots-sharegpt)
37
+ - [limarp](https://huggingface.co/datasets/lemonilia/LimaRP)
38
+ - [toxic-dpo-v0.1-sharegpt](https://huggingface.co/datasets/Undi95/toxic-dpo-v0.1-sharegpt)
39
+ - [ToxicQAFinal](NobodyExistsOnTheInternet/ToxicQAFinal)
40
+
41
+ ### Custom format:
42
+ ```
43
+ ### Instruction:
44
+ {system prompt}
45
+
46
+ ### Input:
47
+ {input}
48
+
49
+ ### Response:
50
+ {reply}
51
+ ```
52
+
53
+ ## Others
54
+
55
+ Undi: If you want to support us, you can [here](https://ko-fi.com/undiai).
56
+
57
+ IkariDev: Visit my [retro/neocities style website](https://ikaridevgit.github.io/) please kek