I download ggml-model-q4_0.bin from your site, but error when run, I cann't fix it, Can you help me?
#1
by
pengsiyue
- opened
llama.cpp % ./main -m ./models/7B/ggml-model-q4_0.bin -n 128
main: build = 634 (5b57a5b)
main: seed = 1686131839
llama.cpp: loading model from ./models/7B/ggml-model-q4_0.bin
error loading model: unexpectedly reached end of file
llama_init_from_file: failed to load model
llama_init_from_gpt_params: error: failed to load model './models/7B/ggml-model-q4_0.bin'
main: error: unable to load model
Please use the latest repo https://huggingface.co/vihangd/open_llama_7b_700bt_ggml the quantization method has changed.
It works，thanks
vihangd
changed discussion status to
closed