RuntimeError on MTEB leaderboard

#123
by mdpi-ai - opened

I got the following error on the leaderboard.

Runtime error
est
resp = self.send(prep, **send_kwargs)
File "/usr/local/lib/python3.10/site-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
File "/usr/local/lib/python3.10/site-packages/huggingface_hub/utils/_http.py", line 66, in send
return super().send(request, *args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/requests/adapters.py", line 532, in send
raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: (ReadTimeoutError("HTTPSConnectionPool(host='huggingface.co', port=443): Read timed out. (read timeout=10)"), '(Request ID: d06e69df-d490-4cc0-b7cc-14ef330650e0)')

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/home/user/app/app.py", line 346, in
data_overall, data_tasks = get_mteb_average(board_config["tasks"], refresh=False)
File "/home/user/app/app.py", line 301, in get_mteb_average
DATA_OVERALL = get_mteb_data(
File "/home/user/app/app.py", line 216, in get_mteb_data
readme_path = hf_hub_download(model.modelId, filename="README.md")
File "/usr/local/lib/python3.10/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
return fn(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 1221, in hf_hub_download
return _hf_hub_download_to_cache_dir(
File "/usr/local/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 1325, in _hf_hub_download_to_cache_dir
_raise_on_head_call_error(head_call_error, force_download, local_files_only)
File "/usr/local/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 1826, in _raise_on_head_call_error
raise LocalEntryNotFoundError(
huggingface_hub.utils._errors.LocalEntryNotFoundError: An error happened while trying to locate the file on the Hub and we cannot find the requested files in the local cache. Please check your connection and try again or make sure your Internet connection is on.

Massive Text Embedding Benchmark org

Hello!

Thanks for reporting, looks like it timed out when it was rebuilding after I pushed this commit.
It's restarting now, I'll keep an eye on it.

  • Tom Aarsen
Massive Text Embedding Benchmark org

I think it's back online, so I'll close this issue now. Let me know if there's any more issues in the future!

  • Tom Aarsen
tomaarsen changed discussion status to closed

Sign up or log in to comment