Model fail, re-eval request ๐Ÿ˜Š

#885
by dnhkng - opened
Open LLM Leaderboard org

Hi @dnhkng ,

I have resubmitted your model, please, check the request file!

I will close this issue, please, ping me here if you need any help with this model again or open a new one

alozowski changed discussion status to closed

Hi alozowski,

That model seems to still be 'failed'.

I now also noticed my Llama-3.1 model also failed:
https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/dnhkng/RYS-Llama3.1-Large_eval_request_False_bfloat16_Original.json

Could I have that resubmitted too? Thanks for all the support ๐Ÿ˜Š

alozowski changed discussion status to open
Open LLM Leaderboard org

Hi @dnhkng ,

I've resubmitted your model, should be fine! I'll keep an eye on it and keep this discussion open for a while

Open LLM Leaderboard org

UPD: I've resubmitted your model again, it failed because of the network issue. It should be fine now. I close this issue, please, feel free to ping me here in case of any problems with this model or open a new discussion

alozowski changed discussion status to closed
Open LLM Leaderboard org

Hi @dnhkng ,

  • dnhkng/RYS-XLarge-base is RUNNING according to the request file, and should appear on the Leaderboard soon
  • dnhkng/RYS-Llama-3.1-8B-Instruct is FINISHED and you can find this model on the Leaderboard

Hi again,

Back from holiday, and I see the model failed again ๐Ÿ˜”

https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/dnhkng/RYS-XLarge-base_eval_request_False_bfloat16_Original.json

Can I get a restart?

alozowski changed discussion status to open
Open LLM Leaderboard org

Hi @dnhkng ,

Thanks for pointing that out! It was a network issue, but it should be fine. I've resubmitted your model, hope we will see the results in the next few days :)

alozowski changed discussion status to closed

Sign up or log in to comment