Intel
/

Qwen2-57B-A14B-Instruct-int4-inc

4-bit precision

intel/auto-round

Model card Files Files and versions Community

weiweiz1 commited on Aug 8

Commit

b6c5c24

•

1 Parent(s): dc51335

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -89,7 +89,7 @@ python3 main.py \
 --disable_eval \
 --nsamples 512 \
 --disable_low_gpu_mem_usage \
---black_list "shared_expert_gate,gate" \
 --deployment_device 'auto_round' \
 --output_dir "./tmp_autoround"
 ```

 --disable_eval \
 --nsamples 512 \
 --disable_low_gpu_mem_usage \
+--layer_blacklist "shared_expert_gate,gate" \
 --deployment_device 'auto_round' \
 --output_dir "./tmp_autoround"
 ```