Any CSV files for the leaderboard as downloadable format?

#1
by zhiminy - opened

I hope to download the leaderboards as CSVs~

SeaEval org

Not really prepared. One possibility is to convert 'all_results.json' as CSV.

Not really prepared. One possibility is to convert 'all_results.json' as CSV.

Thanks for your reply. I checked the format of 'all_results.json' but found it is not directly the results showing up in the leaderboards. I have no idea calculating the metrics on my own based on the raw evaluations. Is that possible to export them via the app.py?

SeaEval org

I would suggest deriving from the JSON file as it contains all the information.

The zero shot results are the Median value of five runs.

I do not think it is easily convertible from app.py as they are not in any CSV format but more like a Dict.

I would suggest deriving from the JSON file as it contains all the information.

The zero shot results are the Median value of five runs.

I do not think it is easily convertible from app.py as they are not in any CSV format but more like a Dict.

Is there any possibility to convert them into dataframe? then I can transform them further into CSV?

SeaEval org

Yes. You can do it.

SeaEval org

Should be easily convertable.

zhiminy changed discussion status to closed

Sign up or log in to comment