Leonard Püttmann
commited on
Update README.md
Browse files
README.md
CHANGED
|
@@ -11,6 +11,13 @@ This model is a finetune of `mistralai/Mistral-7B-Instruct-v0.3`. It was tuned w
|
|
| 11 |
|
| 12 |
The model was trained on an A10G GPU with 24GB of VRAM for about one hour.
|
| 13 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 14 |
## Example:
|
| 15 |
Q: "Please explain the allegory of the cave to me."
|
| 16 |
|
|
|
|
| 11 |
|
| 12 |
The model was trained on an A10G GPU with 24GB of VRAM for about one hour.
|
| 13 |
|
| 14 |
+
### MMLU Philosophy Benchmark
|
| 15 |
+
| Model | MMLU % |
|
| 16 |
+
|----------------------|----------|
|
| 17 |
+
| Mistral 7B | 59.16% |
|
| 18 |
+
| PhilosophyMistral 7B | 64.31% |
|
| 19 |
+
| Mistral Large 2 | 83.28% |
|
| 20 |
+
|
| 21 |
## Example:
|
| 22 |
Q: "Please explain the allegory of the cave to me."
|
| 23 |
|