twhoool02
/

Mistral-7B-AutoGPTQ

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Mistral-7B-AutoGPTQ / gptq_model-4bit-128g.safetensors

Commit History

Upload of AutoGPTQ quantized model

8f5eb7b
verified

twhoool02 commited on Mar 2