File size: 370 Bytes
771e8b2
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
Compatibilty
These files are not compatible with llama.cpp.

Currently they can be used with:

KoboldCpp, a powerful inference engine based on llama.cpp, with good UI: KoboldCpp
The ctransformers Python library, which includes LangChain support: ctransformers
The GPT4All-UI which uses ctransformers: GPT4All-UI
rustformers' llm
The example mpt binary provided with ggml