Can i just runn this in obbabooga?
#10
by
Manni1000
- opened
Can i just runn this in obbabooga?
Yes you can use obbabooga with GGML/GPTQ version which The-Bloke has kindly quantized, as a service to the community, Respect.
Here are links to TheBloke repo
[https://huggingface.co/TheBloke/orca\_mini\_3B-GGML](https://huggingface.co/TheBloke/orca_mini_3B-GGML
https://huggingface.co/TheBloke/orca_mini_7B-GPTQ
https://huggingface.co/TheBloke/orca_mini_7B-GGML
pankajmathur
changed discussion status to
closed