Spaces:
Restarting
on
CPU Upgrade
Restarting
on
CPU Upgrade
Does MoE model supported?
#34
by
maywell
- opened
Hi, just wondering if MoE model supported on this leaderboard.
Plus, what size of model parameters that this leaderboard's gpu cluster can handle?
Thanks.
Hello, I don't think it's possible now. However, we're making a large-scale update to reflect all updates on the English Hugging Face leaderboard within this month. In the process, MoE will be evaluated naturally as well. Currently, it's being evaluated up to 13B safely, but we're going to modify it so that 34B can be evaluated in the same update.
maywell
changed discussion status to
closed