iproskurina
/

Mistral-7B-v0.1-GPTQ-8bit-g128

Text Generation

8-bit precision

Model card Files Files and versions Community

Mistral-7B-v0.1-GPTQ-8bit-g128 / quantize_config.json

Commit History

AutoGPTQ model for mistralai/Mistral-7B-v0.1: 8bits, gr128, desc_act=False

16174da
verified

iproskurina commited on 4 days ago