Quick Question
#1
by
Clevyby
- opened
Hello, do you guys take exl quant requests?
Do you want them for this model?
EDIT - Lonestriker has already provided quants for this https://huggingface.co/LoneStriker/Llama-3-8B-Instruct-262k-8.0bpw-h8-exl2
No, I mean if your willing to take requests for taking specific exl requests on various models from time to time. Would ask specific exl quants from 7-20b from time to time
Yes, no problem. We can do them
Thnx bro. Anyways, I think a seperate repo for model requests would be good for organizational purposes.
If you have time I'd like a 4.25 bpw of Maiden Unquirked 20b
Yes we’re working on a hf space for requests