neuralmagic
/

Mistral-7B-Instruct-v0.3-GPTQ-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Mistral-7B-Instruct-v0.3-GPTQ-4bit / quantize_config.json

Commit History

Initial commit

65aebf9

Eldar Kurtic commited on May 23