Text Generation
Transformers
Safetensors
mixtral
Mixture of Experts
Merge
mergekit
lazymergekit
Felladrin/TinyMistral-248M-SFT-v4
Locutusque/LocutusqueXFelladrin-TinyMistral248M-Instruct
Locutusque/TinyMistral-248M-v2-Instruct
Locutusque/TinyMistral-248M-v2.5
conversational
text-generation-inference
Inference Endpoints
Update README.md
Browse files
README.md
CHANGED
@@ -19,70 +19,6 @@ TinyMixtral-4x248M-MoE is a Mixure of Experts (MoE) made with the following mode
|
|
19 |
* [Locutusque/TinyMistral-248M-v2-Instruct](https://huggingface.co/Locutusque/TinyMistral-248M-v2-Instruct)
|
20 |
* [Locutusque/TinyMistral-248M-v2.5](https://huggingface.co/Locutusque/TinyMistral-248M-v2.5)
|
21 |
|
22 |
-
## 🧩 Configuration
|
23 |
-
|
24 |
-
```yamlbase_model: Felladrin/TinyMistral-248M-SFT-v4
|
25 |
-
experts:
|
26 |
-
- source_model: Felladrin/TinyMistral-248M-SFT-v4
|
27 |
-
positive_prompts:
|
28 |
-
- "reasoning"
|
29 |
-
- "logic"
|
30 |
-
- "problem-solving"
|
31 |
-
- "critical thinking"
|
32 |
-
- "analysis"
|
33 |
-
- "synthesis"
|
34 |
-
- "evaluation"
|
35 |
-
- "decision-making"
|
36 |
-
- "judgment"
|
37 |
-
- "insight"
|
38 |
-
|
39 |
-
- source_model: Locutusque/LocutusqueXFelladrin-TinyMistral248M-Instruct
|
40 |
-
positive_prompts:
|
41 |
-
- "program"
|
42 |
-
- "software"
|
43 |
-
- "develop"
|
44 |
-
- "build"
|
45 |
-
- "create"
|
46 |
-
- "design"
|
47 |
-
- "implement"
|
48 |
-
- "debug"
|
49 |
-
- "test"
|
50 |
-
- "code"
|
51 |
-
- "python"
|
52 |
-
- "programming"
|
53 |
-
- "algorithm"
|
54 |
-
- "function"
|
55 |
-
|
56 |
-
- source_model: Locutusque/TinyMistral-248M-v2-Instruct
|
57 |
-
positive_prompts:
|
58 |
-
- "storytelling"
|
59 |
-
- "narrative"
|
60 |
-
- "fiction"
|
61 |
-
- "creative writing"
|
62 |
-
- "plot"
|
63 |
-
- "characters"
|
64 |
-
- "dialogue"
|
65 |
-
- "setting"
|
66 |
-
- "emotion"
|
67 |
-
- "imagination"
|
68 |
-
- "scene"
|
69 |
-
- "story"
|
70 |
-
- "character"
|
71 |
-
|
72 |
-
- source_model: Locutusque/TinyMistral-248M-v2.5
|
73 |
-
positive_prompts:
|
74 |
-
- "chat"
|
75 |
-
- "conversation"
|
76 |
-
- "dialogue"
|
77 |
-
- "discuss"
|
78 |
-
- "ask questions"
|
79 |
-
- "share thoughts"
|
80 |
-
- "explore ideas"
|
81 |
-
- "learn new things"
|
82 |
-
- "personal assistant"
|
83 |
-
- "friendly helper"
|
84 |
-
```
|
85 |
-
|
86 |
## 💻 Usage
|
87 |
|
88 |
```python
|
@@ -98,7 +34,7 @@ tokenizer = AutoTokenizer.from_pretrained(model)
|
|
98 |
pipeline = transformers.pipeline(
|
99 |
"text-generation",
|
100 |
model=model,
|
101 |
-
|
102 |
)
|
103 |
|
104 |
messages = [{"role": "user", "content": "Explain what a Mixture of Experts is in less than 100 words."}]
|
|
|
19 |
* [Locutusque/TinyMistral-248M-v2-Instruct](https://huggingface.co/Locutusque/TinyMistral-248M-v2-Instruct)
|
20 |
* [Locutusque/TinyMistral-248M-v2.5](https://huggingface.co/Locutusque/TinyMistral-248M-v2.5)
|
21 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
22 |
## 💻 Usage
|
23 |
|
24 |
```python
|
|
|
34 |
pipeline = transformers.pipeline(
|
35 |
"text-generation",
|
36 |
model=model,
|
37 |
+
tokenizer=tokenizer
|
38 |
)
|
39 |
|
40 |
messages = [{"role": "user", "content": "Explain what a Mixture of Experts is in less than 100 words."}]
|