Koolchh
/

Taiwan-LLM-13B-v2.0-chat-4bits-GPTQ

Text Generation

Inference Endpoints

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Edit model card

Author of Taiwan-LLM-13B-v2.0-chat: Yen-Ting Lin

Quantized with c4 dataset.

Downloads last month: 15

Safetensors

Model size

2.03B params

Tensor type

I32

·

FP16

·