Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,18 @@
|
|
1 |
-
---
|
2 |
-
|
3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
datasets:
|
3 |
+
- TIGER-Lab/MathInstruct
|
4 |
+
---
|
5 |
+
|
6 |
+
## Introduction
|
7 |
+
The model is trained with Masked Thought Fine-Tuning (MFT), a simple variant of standard Supervised Fine-Tuning (SFT). You can refer to our code and paper below.
|
8 |
+
|
9 |
+
## Links
|
10 |
+
- **Code**: [https://github.com/ChangyuChen347/MaskedThought](https://github.com/ChangyuChen347/MaskedThought)
|
11 |
+
- **Paper**: [https://arxiv.org/abs/2403.02178](https://arxiv.org/abs/2403.02178)
|
12 |
+
|
13 |
+
## Results
|
14 |
+
We test it with the Hybrid decoding scripts provided in [MAmmoTH](https://github.com/TIGER-AI-Lab/MAmmoTH).
|
15 |
+
| Model | GSM8K | MATH |
|
16 |
+
|----------------------------------------------------------------------------------------------------------------------------------|-------|-------|
|
17 |
+
| [adalaw/MAmmoTH-7B-Mistral-MFT](https://huggingface.co/adalaw/MAmmoTH-7B-Mistral-MFT) | 77.10 | 41.2 |
|
18 |
+
| [TIGER-Lab/MAmmoTH-7B-Mistral-SFT](https://huggingface.co/TIGER-Lab/MAmmoTH-7B-Mistral) | 75.00 | 40.0 |
|