csdc-atl
/

Baichuan2-13B-Chat-GPTQ-Int4

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Baichuan2-13B-Chat-GPTQ-Int4 / handler.py

Commit History

gptq

7569f89

waterhorse1 commited on Sep 15, 2023