root commited on
Commit
4b92b22
·
1 Parent(s): 531422a

update README

Browse files
Files changed (1) hide show
  1. evaluation/long_32k_eval/README.md +12 -0
evaluation/long_32k_eval/README.md ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ This is our script to evaluate 32k long context task
2
+
3
+ You need to first install dependencies from requirement.txt
4
+ ```
5
+ pip install -r requirement.txt
6
+ ```
7
+
8
+ Then you need to configure the model_path and data_home in *eval_retro_vllm.sh* and then run the following command
9
+ ```
10
+ bash run_eval_vllm.sh
11
+ ```
12
+ to get the corresponding score