TheBloke
/

falcon-40b-instruct-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

falcon-40b-instruct-GPTQ / gptq_model-4bit--1g.safetensors

Commit History

Initial AutoGPTQ model commit

58a9172

TheBloke commited on May 27, 2023