Compatibilty
These files are not compatible with llama.cpp.

Currently they can be used with:

KoboldCpp, a powerful inference engine based on llama.cpp, with good UI: KoboldCpp
The ctransformers Python library, which includes LangChain support: ctransformers
The GPT4All-UI which uses ctransformers: GPT4All-UI
rustformers' llm
The example mpt binary provided with ggml