All models are ggml V1 with the latest llama-cpp-python 0.1.70 occurs error: object has no attribute 'model'
#1
by
cdgaete
- opened
All models are ggml V1 with the latest llama-cpp-python 0.1.70 occurs error: object has no attribute 'model'
AttributeError: 'LlamaCppModel' object has no attribute 'model'
Is there any known solution or do we have to downgrade llama-cpp-python until it works?
Thanks!
You can't use llama-cpp-python at all - it's not compatible with this kind of GGMLs. Please see the README for a list of compatible software.
I guess I should mention specifically that llama-cpp-python is also not compatible. llama-cpp-python only supports what llama.cpp supports, hence if llama.cpp can't support it, nor can llama-cpp-python. But in future I will make that explicit.