Missing binaries?
#7
by
rikus2904
- opened
I hope this is not a stupid question, but why doesn't this repo contain the binaries like, for instance, elinas/llama-65b-hf-transformers-4.29 does? How can one procure them?
You get the original llama weights through legitimate means then you run the convert to hf weights script which can be found in the tranformers GitHub repo. This does not contain them because I decided to upload a 4bit quantized version instead.