Hugging Face's logo

Spaces:
AIR-Bench
/
leaderboard
Runtime error

App Files Community
28

Display the number of parameters for the models

#6
by nan - opened
Discussion
nan
 AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark org

Comparing model of different sizes is not fair.

hanhainebula
 AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark org

This feature can be implemented by referring to mteb leaderboard: https://github.com/embeddings-benchmark/leaderboard/blob/5aa7abc2d398e39e8a0dd593fe9088a7150c0f2f/utils/model_size.py#L13.

An additional Model Size Selector filter need to be implemented.

Sign up or log in to comment