TheBloke
/

Airoboros-7B-GPT4-1-4-SuperHOT-8K-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Airoboros-7B-GPT4-1-4-SuperHOT-8K-GPTQ / quantize_config.json

Commit History

Update for Transformers GPTQ support

2bcd688

TheBloke commited on Aug 21, 2023

Initial GPTQ model commit

f2430de

TheBloke commited on Jul 6, 2023