Undi95 commited on
Commit
646982a
1 Parent(s): 0b3e859

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +44 -6
README.md CHANGED
@@ -1,27 +1,61 @@
1
  ---
2
  base_model:
 
3
  - rombodawg/Open_Gpt4_8x7B_v0.2
4
  - mistralai/Mixtral-8x7B-Instruct-v0.1
5
- - NeverSleep/Noromaid-v0.1-mixtral-8x7b-Instruct-v3
6
  tags:
7
  - mergekit
8
  - merge
9
-
 
 
10
  ---
11
- # out2
12
 
13
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
14
 
15
  ## Merge Details
16
  ### Merge Method
17
 
18
- This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [rombodawg/Open_Gpt4_8x7B_v0.2](https://huggingface.co/rombodawg/Open_Gpt4_8x7B_v0.2) as a base.
19
 
20
  ### Models Merged
21
 
22
  The following models were included in the merge:
23
- * [mistralai/Mixtral-8x7B-Instruct-v0.1](https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1)
24
  * [NeverSleep/Noromaid-v0.1-mixtral-8x7b-Instruct-v3](https://huggingface.co/NeverSleep/Noromaid-v0.1-mixtral-8x7b-Instruct-v3)
 
25
 
26
  ### Configuration
27
 
@@ -44,3 +78,7 @@ parameters:
44
  int8_mask: true
45
  dtype: bfloat16
46
  ```
 
 
 
 
 
1
  ---
2
  base_model:
3
+ - NeverSleep/Noromaid-v0.1-mixtral-8x7b-Instruct-v3
4
  - rombodawg/Open_Gpt4_8x7B_v0.2
5
  - mistralai/Mixtral-8x7B-Instruct-v0.1
 
6
  tags:
7
  - mergekit
8
  - merge
9
+ - not-for-all-audiences
10
+ - nsfw
11
+ license: cc-by-nc-4.0
12
  ---
 
13
 
14
+ <!-- description start -->
15
+ ## Description
16
+
17
+ This repo contains fp16 files of NoromaidxOpenGPT4-2.
18
+
19
+ The model was created by merging Noromaid-8x7b-Instruct with Open_Gpt4_8x7B_v0.2 the exact same way [Rombodawg](https://huggingface.co/rombodawg) done his merge.
20
+
21
+ The only difference between [NoromaidxOpenGPT4-1](https://huggingface.co/NeverSleep/NoromaidxOpenGPT4-1/) and [NoromaidxOpenGPT4-2](https://huggingface.co/NeverSleep/NoromaidxOpenGPT4-2/) is that the first iteration use Mixtral-8x7B as a base for the merge (f16), where the second use Open_Gpt4_8x7B_v0.2 as a base (bf16).
22
+
23
+ After further testing and usage, the two model was released, because they each have their own qualities.
24
+
25
+ You can download the imatrix file to do many other quant [HERE](https://huggingface.co/NeverSleep/NoromaidxOpenGPT4-2/blob/main/imatrix-2.dat).
26
+ <!-- description end -->
27
+ <!-- prompt-template start -->
28
+ ### Prompt template:
29
+
30
+ ## Alpaca
31
+
32
+ ```
33
+ ### Instruction:
34
+ {system prompt}
35
+
36
+ ### Input:
37
+ {prompt}
38
+
39
+ ### Response:
40
+ {output}
41
+ ```
42
+
43
+ ## Mistral
44
+
45
+ ```
46
+ [INST] {prompt} [/INST]
47
+ ```
48
 
49
  ## Merge Details
50
  ### Merge Method
51
 
52
+ This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [mistralai/Mixtral-8x7B-Instruct-v0.1](https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1) as a base.
53
 
54
  ### Models Merged
55
 
56
  The following models were included in the merge:
 
57
  * [NeverSleep/Noromaid-v0.1-mixtral-8x7b-Instruct-v3](https://huggingface.co/NeverSleep/Noromaid-v0.1-mixtral-8x7b-Instruct-v3)
58
+ * [rombodawg/Open_Gpt4_8x7B_v0.2](https://huggingface.co/rombodawg/Open_Gpt4_8x7B_v0.2)
59
 
60
  ### Configuration
61
 
 
78
  int8_mask: true
79
  dtype: bfloat16
80
  ```
81
+
82
+ ### Support
83
+
84
+ If you want to support us, you can [here](https://ko-fi.com/undiai).