Congrats to the new leaderboard! Accidentally uploaded the wrong modeltype.

#794
by DavidGF - opened

First of all, congratulations to the Huggingface Open_llm_leaderboard team!!!

Your work is definitely taking the Open Source LLM community a step further!

By using significantly stronger and more meaningful benchmarks, it is now possible to distinguish even better between the performance of the individual models.

Unfortunately, I accidentally didn't upload all of our models that we would like to have evaluated into the queue as chat models (without checking the chat template box). However, since the basic models on which our finetunes are based were uploaded as chat models, it would be important to change the models to chat model and chat template.

I would be super grateful if you could change this for our Vago models:
https://huggingface.co/VAGOsolutions/Llama-3-SauerkrautLM-70b-Instruct
https://huggingface.co/VAGOsolutions/SauerkrautLM-Mixtral-8x7B-Instruct
https://huggingface.co/VAGOsolutions/SauerkrautLM-Qwen-32b
https://huggingface.co/VAGOsolutions/SauerkrautLM-SOLAR-Instruct
https://huggingface.co/VAGOsolutions/SauerkrautLM-7b-LaserChat
https://huggingface.co/VAGOsolutions/SauerkrautLM-7b-HerO
https://huggingface.co/VAGOsolutions/SauerkrautLM-Gemma-7b
https://huggingface.co/VAGOsolutions/SauerkrautLM-1.5b
https://huggingface.co/VAGOsolutions/SauerkrautLM-Gemma-2b

I apologize for any inconvenience caused.

Open LLM Leaderboard org

Hi, could you open a PR on the request files please?

Hi @clefourrier
done :)
Thanks in advance!

Open LLM Leaderboard org

I'm sorry for being unclear, I meant one PR for all files to make it easier for us to merge :)
I did it manually in the end since I could not merge your PRs, happy evaluating!

clefourrier changed discussion status to closed

Thank you very much @clefourrier :)

Sign up or log in to comment