Update README.md
Browse files
README.md
CHANGED
@@ -31,8 +31,8 @@ With these datasets, we achieve the following scores on the JGLUE benchmark:
|
|
31 |
| jnli-1.1-0.3 | 0.504 | 0.48 |
|
32 |
| marc_ja-1.1-0.3 | 0.936 | 0.959 |
|
33 |
|
34 |
-
We achieved these scores by using the [lm-evaluation-harness](https://github.com/Stability-AI/lm-evaluation-harness) from Stability AI.
|
35 |
|
|
|
36 |
```bash
|
37 |
MODEL_ARGS=pretrained=lightblue/openorca_stx,use_accelerate=True
|
38 |
TASK="jsquad-1.1-0.3,jcommonsenseqa-1.1-0.3,jnli-1.1-0.3,marc_ja-1.1-0.3"
|
|
|
31 |
| jnli-1.1-0.3 | 0.504 | 0.48 |
|
32 |
| marc_ja-1.1-0.3 | 0.936 | 0.959 |
|
33 |
|
|
|
34 |
|
35 |
+
We achieved these scores by using the [lm-evaluation-harness](https://github.com/Stability-AI/lm-evaluation-harness) from Stability AI using the below commands:
|
36 |
```bash
|
37 |
MODEL_ARGS=pretrained=lightblue/openorca_stx,use_accelerate=True
|
38 |
TASK="jsquad-1.1-0.3,jcommonsenseqa-1.1-0.3,jnli-1.1-0.3,marc_ja-1.1-0.3"
|