35B is not the right number of Active parameters

#9
by kyo-takano - opened

Although it seems like the number 35B was derived as round(140.6B * 2 / 8), the actual number of active parameters is approximately 39B. See this discussion for the math.

Although it would be too late to change the model name, the model card could be corrected accordingly.

Hugging Face H4 org
lewtun changed discussion status to closed

Sign up or log in to comment