Plans to add your model to the Open LLM Leaderboard?
#6
by
ThiloteE
- opened
I cannot find it there (https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard). If the evaluation results you posted are correct, you would be at the top of the leaderboard for 3B models, beating second place with a large margin ;-)
Hi! Unfortunately, the StableLM class is not present by default in transformers library, so it uses custom code.
ATM, afaik, it is not possible to submit the model if it uses custom code.
Ah, thanks for the explanation.
pansophic
changed discussion status to
closed