| Compatibilty | |
| These files are not compatible with llama.cpp. | |
| Currently they can be used with: | |
| KoboldCpp, a powerful inference engine based on llama.cpp, with good UI: KoboldCpp | |
| The ctransformers Python library, which includes LangChain support: ctransformers | |
| The GPT4All-UI which uses ctransformers: GPT4All-UI | |
| rustformers' llm | |
| The example mpt binary provided with ggml |