Please do the 13b version for the community!
#2
by
Yhyu13
- opened
Would you like to release the 13B versions as well? Their project readme proclaims a 97% chatgpt score evaluated by gpt4, which is amazing!
Notice there are two versions of chimera, I guess the "inst" ones are more performant
Hello!
I answered this question before, but closed the issue. I let this open so other one can see it:
I can't do a 13b version right now because I only get Out Of Memory Error's while quantizing. I have 2 3060 12gb's and I didn't found a way to quantize using both gpu's.
Sorry about that.