Have you got it to work?
#1
by
totally-not-an-llm
- opened
Thanks for the quants for my model! Have you got these to work?
No problem, Ill build a simple space in spare time so you can try it out!
Sorry, I was wondering if these quants work locally for you, in oobabooga it gives me an error.
I am not familiar with oobaboga, but here it works fine. https://huggingface.co/spaces/s3nh/totally-not-an-llm-AlpacaCielo2-7b-8k-GGML