BenCzechMark / server.py

Commit History

Tuning the duration of some notifications
73f436c

idolezal commited on

Upload only when it could be changed
e2d6d6c

idolezal commited on

Do not read big JSON file twice
0e8ff48

idolezal commited on

More info notifications
9d3d879

idolezal commited on

Default sorting of leaderboard is by "average_score"
81fdab8

idolezal commited on

For testing purpose improved fake tournament
54b531c

idolezal commited on

Locks only on confirmation of submission
2e42a59

idolezal commited on

Now only executes the duels that are missing
dfdc202

idolezal commited on

Upload to the dataset the map from "submission_id" to "model_title"
8ae0f62

idolezal commited on

Get task names only from "tasks_metadata.json"
387e6ad

idolezal commited on

Use specified metric for every task
9225102

idolezal commited on

Prepare to pandas 3.0
c3d760a

idolezal commited on

Repeat when connection to check significance server is timed out
7d453b5

idolezal commited on

Better check significance server reachable test
1405ed9

idolezal commited on

Removed `delete_on_close` parameter, because it's since Python 3.12
c164d65

idolezal commited on

Restart space if check significance server is not reachable
34bacde

idolezal commited on

Reduced loading of pre-submited model JSON file
6762695

idolezal commited on

Enabled getting leaderboard and model tournament table and CSV for pre-submit
3b8382c

idolezal commited on

For CSV export added "n-shot" attribute
c6d7faa

idolezal commited on

Enabled Overall with details, mainly for CSV format
690c597

idolezal commited on

Enabled to get Overall for make model_tournament_results_table
acca45a

idolezal commited on

Added the button for restart the space
ed52286

idolezal commited on

User managed solution for a new tournament creation
136803a

idolezal commited on

Measuring how long it takes to renew tournament results
461d770

idolezal commited on

Call update_leaderboard() after results_dataset_integrity_check()
3b741bb

idolezal commited on

Added timeout to pre_submit_lock in while-cycle
d10a698

idolezal commited on

For testing purpose create pre-submit from fake tournament
36141d4

idolezal commited on

New format of model data: renamed "metadata" to "submission_metadata"
3f5825a

idolezal commited on

Tournament results in CSV format should only have the "significant" attribute
f2cb73a

idolezal commited on

The file name must not contain a slash
6586c80

idolezal commited on

It is possible to download tournament results for each model and category (except Overall) in CSV format
3eee636

idolezal commited on

CSV have to use different dataframe without Markdown and HTML
96c0414

idolezal commited on

It is possible to download leaderboard Overall in CSV format
32a069d

idolezal commited on

Init of LeaderboardServer.tournament_dataframes
911ea92

idolezal commited on

Join dataframes update
2e909a5

idolezal commited on

Prepare tournament dataframes
6874981

idolezal commited on

Use shallow copy for faster loading
4a56366

idolezal commited on

Prepare leaderboard dataframes
1fc0ff9

idolezal commited on

Add environment variable HF_RESULTS_DATASET for easy cloning
1dad510

idolezal commited on

the maximum length of the model title is now as constant
07fde84

idolezal commited on

Replaced RuntimeError with CheckSignificanceError
e0ba174

idolezal commited on

Exception gr.error doesn't make sense here
ce9b173

idolezal commited on

Decrease amount of updating leaderboard source data
b299ccd

idolezal commited on

Rename variable containing path to snapshot
e46762c

idolezal commited on

Uppercase name of constant variables
934ac05

idolezal commited on

Prepare tournament results out of critical section
3daddec

idolezal commited on

Fixed critical section
952f194

idolezal commited on

Defined xmlAndMarkdownEscape() function
20d80fe

idolezal commited on

More info to table of the tasks
6bae7e8

idolezal commited on

Order of `match_task_result_details` attributes
7e24376

idolezal commited on