ironrock commited on
Commit
d3f7eeb
1 Parent(s): 4be16c1

Upload quant_config.json with huggingface_hub

Browse files
Files changed (1) hide show
  1. quant_config.json +1 -0
quant_config.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"quant_method": "awq", "zero_point": true, "q_group_size": 128, "w_bit": 4, "version": "gemm", "modules_to_not_convert": null}