OPEA
/

Falcon3-10B-Base-int4-sym-awq-inc

4-bit precision

Model card Files Files and versions Community

cicdatopea commited on 24 days ago

Commit

6e547d4

·

verified ·

1 Parent(s): 7cb82f1

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -134,7 +134,7 @@ auto-round  \
 --iter 1000 \
 --disable_eval \
 --model_dtype 'float16' \
---format 'auto_gptq,auto_round' \
 --output_dir "./tmp_autoround"
 ```

 --iter 1000 \
 --disable_eval \
 --model_dtype 'float16' \
+--format 'auto_awq,auto_gptq,auto_round' \
 --output_dir "./tmp_autoround"
 ```