We need Salesforce/xgen-7b-8k-inst GGML
#1
by
Ekolawole
- opened
Hello TheBloke. Can you create a GGML version for Salesforce/xgen-7b-8k-inst
It has better reasoning than other 7B models
I looked at it. The issue is that it needs a special tokeniser, tiktoken, which is not supported in GGML, and which none of the GPTQ UIs support yet. As soon as this is supported by one or more popular inference clients, I will do a model