how to evaluate mpt model

#84
by lvkaokao - opened

image.png

Open LLM Leaderboard org

Hi! The MPT models are now part of the transformers library (see here).
As soon as they are integrated in a stable release, we will update our version of transformers to allow submission of MPT models!

clefourrier changed discussion status to closed
Open LLM Leaderboard org

Hi @lvkaokao ,
With the latest transformers release, we now support MPT models, feel free to resubmit the models you were interested in!

Sign up or log in to comment