gagan3012 commited on
Commit
0bf35a9
1 Parent(s): 5d9eaff

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -54
README.md CHANGED
@@ -16,7 +16,8 @@ language:
16
 
17
  # Multirial
18
 
19
- This model is a Mixure of Experts (MoE) made with [mergekit](https://github.com/cg123/mergekit) (mixtral branch). It uses the following base models:
 
20
  * [fblgit/UNA-TheBeagle-7b-v1](https://huggingface.co/fblgit/UNA-TheBeagle-7b-v1)
21
  * [openchat/openchat-3.5-0106](https://huggingface.co/openchat/openchat-3.5-0106)
22
  * [azale-ai/Starstreak-7b-beta](https://huggingface.co/azale-ai/Starstreak-7b-beta)
@@ -26,59 +27,6 @@ This model is a Mixure of Experts (MoE) made with [mergekit](https://github.com/
26
  * [manishiitg/open-aditi-hi-v1](https://huggingface.co/manishiitg/open-aditi-hi-v1)
27
  * [VAGOsolutions/SauerkrautLM-7b-v1-mistral](https://huggingface.co/VAGOsolutions/SauerkrautLM-7b-v1-mistral)
28
 
29
- ## 🧩 Configuration
30
-
31
- ```yamlbase_model: gagan3012/Mistral_arabic_dpo
32
- dtype: bfloat16
33
- experts:
34
- - positive_prompts:
35
- - chat
36
- - assistant
37
- - tell me
38
- - explain
39
- source_model: fblgit/UNA-TheBeagle-7b-v1
40
- - positive_prompts:
41
- - chat
42
- - assistant
43
- - tell me
44
- - explain
45
- source_model: openchat/openchat-3.5-0106
46
- - positive_prompts:
47
- - indonesian
48
- - indonesia
49
- - answer in indonesian
50
- source_model: azale-ai/Starstreak-7b-beta
51
- - positive_prompts:
52
- - arabic
53
- - arab
54
- - arabia
55
- - answer in arabic
56
- source_model: gagan3012/Mistral_arabic_dpo
57
- - positive_prompts:
58
- - korean
59
- - answer in korean
60
- - korea
61
- source_model: davidkim205/komt-mistral-7b-v1
62
- - positive_prompts:
63
- - chinese
64
- - china
65
- - answer in chinese
66
- source_model: OpenBuddy/openbuddy-zephyr-7b-v14.1
67
- - positive_prompts:
68
- - hindi
69
- - india
70
- - hindu
71
- - answer in hindi
72
- source_model: manishiitg/open-aditi-hi-v1
73
- - positive_prompts:
74
- - german
75
- - germany
76
- - answer in german
77
- - deutsch
78
- source_model: VAGOsolutions/SauerkrautLM-7b-v1-mistral
79
- gate_mode: hidden
80
- ```
81
-
82
  ## 💻 Usage
83
 
84
  ```python
 
16
 
17
  # Multirial
18
 
19
+ MultiRial is the first ever multilingual Mixture of experts model.
20
+
21
  * [fblgit/UNA-TheBeagle-7b-v1](https://huggingface.co/fblgit/UNA-TheBeagle-7b-v1)
22
  * [openchat/openchat-3.5-0106](https://huggingface.co/openchat/openchat-3.5-0106)
23
  * [azale-ai/Starstreak-7b-beta](https://huggingface.co/azale-ai/Starstreak-7b-beta)
 
27
  * [manishiitg/open-aditi-hi-v1](https://huggingface.co/manishiitg/open-aditi-hi-v1)
28
  * [VAGOsolutions/SauerkrautLM-7b-v1-mistral](https://huggingface.co/VAGOsolutions/SauerkrautLM-7b-v1-mistral)
29
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
30
  ## 💻 Usage
31
 
32
  ```python