kaitchup
/

Qwen2.5-72B-Instruct-AutoRound-GPTQ-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Qwen2.5-72B-Instruct-AutoRound-GPTQ-4bit

Commit History

Update README.md

8cc9adc
verified

bnjmnmarie commited on Nov 13, 2024

Upload tokenizer

82e56c4
verified

bnjmnmarie commited on Nov 12, 2024

Upload Qwen2ForCausalLM

2e366ff
verified

bnjmnmarie commited on Nov 12, 2024

initial commit

e710185
verified

bnjmnmarie commited on Nov 12, 2024