quantized model Version?

#2
by thanhtan2136 - opened

I hope in future this model can have more ver quantized for LLM deploy

EraX JS Company org

We will release quantized version soon.

Stay tune, a 2B version is coming shortly, same quality, and can run on mobile phone or with CPU !

Cheers,
Nguyên

amazing , thanks for sharing :D I hope can try 2B version

I also wish, hope there will be a version for weak GPU soon, thank you very much developer

EraX JS Company org

Bản 2B V1.5 có rồi nhé, khá hơn.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment