Qwen
/

Qwen2.5-Coder-3B-Instruct-GPTQ-Int8

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

Qwen2.5-Coder-3B-Instruct-GPTQ-Int8 / generation_config.json

Commit History

update tokenizer_config.json,config.json,generation_config.json

77324e4

JustinLin610 commited on Nov 18, 2024

upload weights

12beb87

feihu.hf commited on Nov 9, 2024