Upload quantize_config.json (#4)

- Upload quantize_config.json (bcc0553981ef66d2f78c40aeac640303e4161851)


Co-authored-by: Nikita <nikitastaf1996@users.noreply.huggingface.co>

quantize_config.json

@@ -0,0 +1,8 @@
+{
+  "bits": 4,
+  "group_size": 128,
+  "damp_percent": 0.01,
+  "desc_act": false,
+  "sym": true,
+  "true_sequential": true
+}