4bit

/

falcon-7b-instruct-GPTQ

like 3

Error below when trying to download pipeline like so:
pipe = pipeline("text-generation", model="4bit/falcon-7b-instruct-GPTQ", trust_remote_code=True, device_map="auto")

OSError: 4bit/falcon-7b-instruct-GPTQ does not appear to have a file named pytorch_model.bin, tf_model.h5, model.ckpt or flax_model.msgpack.