fbaldassarri
/

tiiuae_Falcon3-3B-Instruct-autogptq-int8-gs128-sym

Text Generation

intel-autoround

text-generation-inference

8-bit precision

Model card Files Files and versions Community

tiiuae_Falcon3-3B-Instruct-autogptq-int8-gs128-sym / quantize_config.json

Commit History

Initial Upload

a136bb0
verified

fbaldassarri commited on 18 days ago