GGUF

Model is broken in latest llama.cpp

#1
by jackboot - opened

The model doesn't load in llama.cpp anymore due to code changes. GGUF have to be remade from scratch :(

Sorry for the late Answer (didn't notice...)
Hopefully you already found the https://huggingface.co/maddes8cht/tiiuae-falcon-40b-gguf
:)

Sign up or log in to comment