Hugging Face's logo

TheBloke
/
Llama-2-70B-GGUF

Text Generation
Transformers
GGUF
PyTorch
English
llama
facebook
meta
llama-2
Model card Files Community
4

Problem with using Q8_0 file and Q6_K file

#3
by aritra03 - opened
Discussion
aritra03

I have tried using both files after downloading the two separate splits a and b of both files. And also used the command cat. But llamacpp cannot load the final model.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment