Commit
•
f72a663
1
Parent(s):
a157878
Update README.md
Browse files
README.md
CHANGED
|
@@ -6,7 +6,7 @@
|
|
| 6 |
|
| 7 |
Oh boy, a new model architecture in Transformers! Time to do profane things with it.
|
| 8 |
|
| 9 |
-
What if instead of training a MoE from scratch, we took some pre-trained Mistral models and shoved them in a little clown car?
|
| 10 |
|
| 11 |
|
| 12 |
Uses parts from the following models:
|
|
|
|
| 6 |
|
| 7 |
Oh boy, a new model architecture in Transformers! Time to do profane things with it.
|
| 8 |
|
| 9 |
+
What if instead of training a MoE from scratch, we took some pre-trained Mistral models and shoved them in a little clown car?
|
| 10 |
|
| 11 |
|
| 12 |
Uses parts from the following models:
|