Model was not found on hub!

#338
by Abe13 - opened

Upon attempting to submit my model for Open LLM benchmarking, I encountered the following error message:

Model "my_model_path_on_HF" was not found on hub!

Do you have any suggestions for resolving this issue?

Open LLM Leaderboard org

Hi, is your model private? If no, what is the actual path to your model?

Same error with jondurbin/airoboros-m-7b-3.1.2

same error with lvkaokao/mistral-7b-finetuned-orca-dpo-v2

can confirm.. same error. model is public. @clefourrier

can confirm.. same error. model is public. @clefourrier

@clefourrier No, I have made the model public.
Here is the HF path: Abe13/full-juni-v0.1

teknium/OpenHermes-2-Mistral-7B was not found on hub
@clefourrier

Open LLM Leaderboard org
edited Oct 26, 2023

Hi folks!
We are currently investigating, please be patient.

Side note: dear users ( @lvkaokao @rishiraj @Abe13 @ehartford ), please do not ping me 4 times in a time span of 24 hours :)
I am checking the issues on the leaderboard several times a day when I am working, and if I don't respond, I'm either off or already working on fixing your issues or upgrading the leaderboard.

Open LLM Leaderboard org

It's been fixed! (We had a requirements mismatch between our libraries which installed a too old version of transformers for mistral based models)

Happy model submitting! 🤗

clefourrier changed discussion status to closed

Thank you :D

Sign up or log in to comment