OPEA
/

Meta-Llama-3.1-405B-Instruct-int4-sym-inc

4-bit precision

intel/auto-round

Model card Files Files and versions Community

Meta-Llama-3.1-405B-Instruct-int4-sym-inc / config.json

Commit History

change to fp16

417447c

wenhuach commited on Dec 17, 2024

autoround format

cb38f4a

wenhuach commited on Dec 17, 2024