Can't load your model
#1
by
leo-nid
- opened
Hello!
How to load your model???
In your repo have unactual info about standard model.
If I load your model with PyTorch then loading OrderDict of state is actual.
This is not PyTorch format. You must use GPTQ. See the GitHub repository linked in the README.
Edit: See this issue, looks like some code in the GPTQ repo has changed https://huggingface.co/elinas/alpaca-30b-lora-int4/discussions/2
elinas
changed discussion status to
closed