OPEA
/

Meta-Llama-3.1-70B-Instruct-int4-sym-inc

4-bit precision

intel/auto-round

Model card Files Files and versions Community

Meta-Llama-3.1-70B-Instruct-int4-sym-inc / model-00006-of-00009.safetensors

Commit History

add autogptq format

90c15db

wenhuach commited on Nov 30, 2024