xxx777xxxASD
commited on
Commit
•
a5ac777
1
Parent(s):
14fa511
Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,64 @@
|
|
1 |
-
---
|
2 |
-
|
3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
language:
|
3 |
+
- en
|
4 |
+
license: llama3
|
5 |
+
tags:
|
6 |
+
- moe
|
7 |
+
---
|
8 |
+
|
9 |
+
<style>
|
10 |
+
.image-container {
|
11 |
+
position: relative;
|
12 |
+
display: inline-block;
|
13 |
+
}
|
14 |
+
|
15 |
+
.image-container img {
|
16 |
+
display: block;
|
17 |
+
border-radius: 10px;
|
18 |
+
box-shadow: 0 0 1px rgba(0, 0, 0, 0.3);
|
19 |
+
}
|
20 |
+
|
21 |
+
.image-container::before {
|
22 |
+
content: "";
|
23 |
+
position: absolute;
|
24 |
+
top: 0px;
|
25 |
+
left: 20px;
|
26 |
+
width: calc(100% - 40px);
|
27 |
+
height: calc(100%);
|
28 |
+
background-image: url("https://cdn-uploads.huggingface.co/production/uploads/64f5e51289c121cb864ba464/O0FlWv4L8ZnehOGETw7qt.png");
|
29 |
+
background-size: cover;
|
30 |
+
filter: blur(10px);
|
31 |
+
z-index: -1;
|
32 |
+
}
|
33 |
+
</style>
|
34 |
+
<br>
|
35 |
+
|
36 |
+
<div class="image-container">
|
37 |
+
<img src="https://cdn-uploads.huggingface.co/production/uploads/64f5e51289c121cb864ba464/O0FlWv4L8ZnehOGETw7qt.png" style="width: 96%; margin: auto;" >
|
38 |
+
</div>
|
39 |
+
|
40 |
+
Experimental RP-oriented MoE
|
41 |
+
|
42 |
+
### Llama 3 ClaudeMaid v1.0 4x8B
|
43 |
+
```
|
44 |
+
base_model: NeverSleep_Lumimaid-v0.2-8B
|
45 |
+
gate_mode: random
|
46 |
+
dtype: bfloat16
|
47 |
+
experts_per_token: 2
|
48 |
+
experts:
|
49 |
+
- source_model: aifeifei798_DarkIdol-Llama-3.1-8B-Instruct-1.0-Uncensored
|
50 |
+
- source_model: Nitral-AI_Sekhmet_Bet-L3.1-8B-v0.2
|
51 |
+
- source_model: NeverSleep_Lumimaid-v0.2-8B
|
52 |
+
- source_model: Undi95_Meta-Llama-3.1-8B-Claude-bf16
|
53 |
+
```
|
54 |
+
|
55 |
+
|
56 |
+
## Models used
|
57 |
+
|
58 |
+
- [NeverSleep/Lumimaid-v0.2-8B](https://huggingface.co/NeverSleep/Lumimaid-v0.2-8B)
|
59 |
+
- [Undi95/Meta-Llama-3.1-8B-Claude](https://huggingface.co/Undi95/Meta-Llama-3.1-8B-Claude)
|
60 |
+
- [Nitral-AI/Sekhmet_Bet-L3.1-8B-v0.2](https://huggingface.co/Nitral-AI/Sekhmet_Bet-L3.1-8B-v0.2)
|
61 |
+
- [aifeifei798/DarkIdol-Llama-3.1-8B-Instruct-1.0-Uncensored](https://huggingface.co/aifeifei798/DarkIdol-Llama-3.1-8B-Instruct-1.0-Uncensored)
|
62 |
+
|
63 |
+
|
64 |
+
## Prompt format: Llama 3
|