submission issues

#1038
by pszemraj - opened

With the new version of the leaderboard, it seems I am unable to submit models because of "Could not determine model size from safetensors or model name" when it's clearly available and stored in safetensors.

For example, https://huggingface.co/PleIAs/Pleias-350m-Preview

image.png

repo files:

image.png

I've just had the same problem as reported by @pszemraj trying to submit https://huggingface.co/schuler/experimental-JP47D20 . Not sure if this is the reason, but my model has plenty of custom (unusual) code.

Open LLM Leaderboard org

Hi everyone!

Thanks for reporting this issue, we are starting to debug it. I'll get back to you here as soon as it will be corrected

FYI, I got the same error for this model: Nexusflow/Athene-V2-Chat (I have submitted models successfully with the new system, just in case)

I am also facing the same issue @alozowski "bhuvneshsaini/merged_model"

Open LLM Leaderboard org

Hi everyone!

Thank you for your patience, all the errors were fixed! Just to test that everything is correct, I submitted all the models you mentioned here, so you can wait for the results

I'm closing this issue, please, feel free to ping me here in case of any other questions on this topic or please open a new discussion

alozowski changed discussion status to closed

@alozowski , thank you so much!

Sign up or log in to comment