Spaces:

open-llm-leaderboard

/

open_llm_leaderboard

like 11.7k

Running on CPU Upgrade

Hi grimjim!

Could you please provide me with the request file?

I'm not sure which file is meant specifically, but the model I submitted is here in full:
https://huggingface.co/grimjim/kunoichi-lemon-royale-7B
It's a merge with bf16 weights.

@grimjim I'm not staff, just letting you know the request file can be found from the link below, which is from the leaderboard's FAQ page. I also included a link to your file. Looks like the evaluation failed (status=failed). The staff should be able to help you out.

https://huggingface.co/datasets/open-llm-leaderboard/requests/tree/main

https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/grimjim/kunoichi-lemon-royale-7B_eval_request_False_bfloat16_Original.json

That's correct, you can see you request files here - https://huggingface.co/datasets/open-llm-leaderboard/requests

We checked the problem, it turns out to be a network issue. I've already rescheduled your model and everything should be fine now.

I'm closing this issue, you can reopen it in case of any questions. Please, don't forget to consult the FAQ page first if you encounter any other issues :)

Thanks for the requeue. Unfortunately, the status is now finished but the model doesn't appear on the leaderboard. Unable to reopen this discussion for some reason.
https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/grimjim/kunoichi-lemon-royale-7B_eval_request_False_bfloat16_Original.json

Hi grimjim!

Sorry for the delay, we need some time to investigate the problem. I'll be back with a solution as soon as possible!

@grimjim you can check the leaderboard now, all results are synced and you can find your model here. Don't forget to uncheck "contains a merge/moerge".

I'll close this issue now, in case of any problems with the model you can reopen it (or I will reopen it after your message)