Application to run this locally?
#3
by
DJsens
- opened
Would I have to make my own script with a GUI etc to have a locally ran chat interface with this model?
Could be missing something but GPT4ALL only allows you to use a select choice of models, correct?
No, not at all. Check the README - I included instructions to easily download it in text-generation-webui. And in text-gen-ui there are instructions on how to easily install that.
Yes the GPT4All-Chat app only allows you to download models they've provided via their website. But they also release their own models here on Hugging Face, allowing people like to quantise and convert them and make them available for use in other UIs and other contexts.