OPEA
/

Meta-Llama-3.1-70B-Instruct-int4-sym-inc

4-bit precision

intel/auto-round

Model card Files Files and versions Community

Meta-Llama-3.1-70B-Instruct-int4-sym-inc / quantization_config.json

Commit History

update to autoround format

2252808

wenhuach commited on Nov 30, 2024