Q6 and Q8?

#1
by gileneo - opened

Is it possible to add Q6 and Q8 for better quality of 70B model generation?

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment