Evaluate fine-tuned MPT-7B-Chat model

#98
by Haihao - opened

Hi,

We tried evaluating the fine-tuned MPT-7B-Chat model, while it seems error appearing like https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard/discussions/84.

Could you please help evaluate https://huggingface.co/Intel/neural-chat-7b-v1.1?

Thanks

Open LLM Leaderboard org

Hi! We'll come back to this once we finish the leaderboard update!

Open LLM Leaderboard org

Hi! The MPT models are now part of the transformers library (see here).
As soon as it's integrated in the next release, we will update our version of transformers to allow submission of MPT models!

clefourrier changed discussion status to closed
Open LLM Leaderboard org

Hi @Haihao !
With the latest transformers release, we now support MPT models, feel free to resubmit your model!

Sign up or log in to comment