Undi95 commited on
Commit
0a02278
1 Parent(s): 7ab76c1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +72 -2
README.md CHANGED
@@ -1,12 +1,68 @@
1
  ---
2
  license: cc-by-nc-4.0
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
4
  This model was trained on the Zloss fork of Charles, and should fix issue the model had.
5
 
6
  Use Chatml prompt format, but not the special token.
7
 
8
- The reason is that Axolotl merge the finetune with the base model at 1 weight basically, but this is too much, so I use another script available [HERE](https://github.com/DocShotgun/LLM-notebooks/blob/main/weighted-lora-merge.ipynb) to merge with less weight, sadly, it don't take the special chatml token.
 
 
 
 
 
 
 
 
 
 
 
 
9
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
10
  ```
11
  <|im_start|>system
12
  {sysprompt}<|im_end|>
@@ -14,4 +70,18 @@ The reason is that Axolotl merge the finetune with the base model at 1 weight ba
14
  {input}<|im_end|>
15
  <|im_start|>assistant
16
  {output}<|im_end|>
17
- ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: cc-by-nc-4.0
3
  ---
4
+
5
+
6
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/630dfb008df86f1e5becadc3/vwcJfOnL-2QDJ0ShfxRJ5.png)
7
+
8
+
9
+
10
+ ---
11
+
12
+ # Disclaimer:
13
+ ## This model is experimental, do not expect everything to work.
14
+
15
+ This model uses the Chatml **prompting format**
16
+
17
+ ---
18
+
19
+
20
+ Beeg noromaid on ***steroids***. Suitable for RP, ERP.
21
+
22
  This model was trained on the Zloss fork of Charles, and should fix issue the model had.
23
 
24
  Use Chatml prompt format, but not the special token.
25
 
26
+ The reason is that Axolotl merge the finetune with the base model at 1.0 weight basically, but this is too much, so I use another script available [HERE](https://github.com/DocShotgun/LLM-notebooks/blob/main/weighted-lora-merge.ipynb) to merge with less weight, sadly, it don't take the special Chatml token. It's like Orca2 for the matter.
27
+
28
+
29
+ ## Credits:
30
+ - Undi
31
+ - IkariDev
32
+
33
+ <!-- description start -->
34
+ ## Description
35
+
36
+ <!-- [Recommended settings - contributed by localfultonextractor](https://files.catbox.moe/ue0tja.json) -->
37
+
38
+ This repo contains GGUF files of Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss.
39
 
40
+ [FP16 - by IkariDev and Undi](https://huggingface.co/NeverSleep/Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss)
41
+
42
+ <!-- [GGUF - By TheBloke](https://huggingface.co/TheBloke/Athena-v4-GGUF)-->
43
+
44
+ <!-- [GPTQ - By TheBloke](https://huggingface.co/TheBloke/Athena-v4-GPTQ)-->
45
+
46
+ <!-- [exl2[8bpw-8h] - by AzureBlack](https://huggingface.co/AzureBlack/Echidna-13b-v0.3-8bpw-8h-exl2)-->
47
+
48
+ <!-- [AWQ - By TheBloke](https://huggingface.co/TheBloke/Athena-v4-AWQ)-->
49
+
50
+ <!-- [fp16 - by IkariDev+Undi95](https://huggingface.co/IkariDev/Athena-v4)-->
51
+
52
+ [GGUF - by IkariDev and Undi](https://huggingface.co/NeverSleep/Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss-GGUF)
53
+ <!-- [OLD(GGUF - by IkariDev+Undi95)](https://huggingface.co/IkariDev/Athena-v4-GGUF)-->
54
+
55
+ ## Ratings:
56
+
57
+ Note: We have permission of all users to upload their ratings, we DONT screenshot random reviews without asking if we can put them here!
58
+
59
+ No ratings yet!
60
+
61
+ If you want your rating to be here, send us a message over on DC and we'll put up a screenshot of it here. DC name is "ikaridev" and "undi".
62
+
63
+ <!-- description end -->
64
+ <!-- prompt-template start -->
65
+ ### Prompt format: Chatml
66
  ```
67
  <|im_start|>system
68
  {sysprompt}<|im_end|>
 
70
  {input}<|im_end|>
71
  <|im_start|>assistant
72
  {output}<|im_end|>
73
+ ```
74
+
75
+ ## Datasets used:
76
+
77
+ - Aesir 1, 2 & 3 modified by us, credit to ([MinervaAI](https://huggingface.co/MinervaAI) / [Gryphe](https://huggingface.co/Gryphe))
78
+ - [LimaRP-20231109](https://huggingface.co/datasets/lemonilia/LimaRP) ([Lemonilia](https://huggingface.co/lemonilia))
79
+ - [ToxicQAFinal](https://huggingface.co/datasets/NobodyExistsOnTheInternet/ToxicQAFinal) ([NobodyExistsOnTheInternet](https://huggingface.co/NobodyExistsOnTheInternet)
80
+ - [No-robots-ShareGPT](https://huggingface.co/datasets/Doctor-Shotgun/no-robots-sharegpt) ([Doctor-Shotgun](https://huggingface.co/Doctor-Shotgun))
81
+
82
+
83
+ ## Others
84
+
85
+ Undi: If you want to support me, you can [here](https://ko-fi.com/undiai).
86
+
87
+ IkariDev: Visit my [retro/neocities style website](https://ikaridevgit.github.io/) please kek