Incorrect vocab size?

#1
by pc9441 - opened

Hello and thanks for sharing Polish model!
I wanted to give it a try, but looks like vocab parameter in GGUF could be set incorrectly here.
When trying to load it with llama.cpp I get following error:

llama_model_load: error loading model: vocab size mismatch
llama_load_model_from_file: failed to load model

thanks for the heads up. there was an issue while converting to GGUF. it should be fixed now

acon96 changed discussion status to closed

Sign up or log in to comment