GSJL
/

Qwen2.5-32B-Instruct-GPTQ-Marlin

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Qwen2.5-32B-Instruct-GPTQ-Marlin / quantize_config.json

Commit History

Upload of AutoGPTQ quantized model

d92b4e8
verified

GSJL commited on Sep 22