OPEA
/

Falcon3-7B-Base-int4-sym-inc

4-bit precision

intel/auto-round

Model card Files Files and versions Community

cicdatopea commited on 6 days ago

Commit

4d4fb5b

•

1 Parent(s): 0fc180e

Update README.md

Files changed (1) hide show

README.md +0 -1

README.md CHANGED Viewed

@@ -102,7 +102,6 @@ auto-round  \
 --seqlen 2048 \
 --iters 1000 \
 --model_dtype "float16" \
---dataset NeelNanda/pile-10k \
 --format 'auto_awq,auto_gptq,auto_round' \
 --output_dir "./tmp_autoround"
 ```

 --seqlen 2048 \
 --iters 1000 \
 --model_dtype "float16" \
 --format 'auto_awq,auto_gptq,auto_round' \
 --output_dir "./tmp_autoround"
 ```