root
commited on
Commit
·
4b92b22
1
Parent(s):
531422a
update README
Browse files
evaluation/long_32k_eval/README.md
ADDED
@@ -0,0 +1,12 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
This is our script to evaluate 32k long context task
|
2 |
+
|
3 |
+
You need to first install dependencies from requirement.txt
|
4 |
+
```
|
5 |
+
pip install -r requirement.txt
|
6 |
+
```
|
7 |
+
|
8 |
+
Then you need to configure the model_path and data_home in *eval_retro_vllm.sh* and then run the following command
|
9 |
+
```
|
10 |
+
bash run_eval_vllm.sh
|
11 |
+
```
|
12 |
+
to get the corresponding score
|