marcsun13
/

Llama-2-13B-AWQ

Text Generation

text-generation-inference

Model card Files Files and versions Community

ybelkada commited on Nov 6, 2023

Commit

4e21267

•

1 Parent(s): 78e0628

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -28,6 +28,6 @@
       "zero_point": true,
       "q_group_size": 128,
       "w_bit": 4,
-      "version": "GEMM"
     }
 }

       "zero_point": true,
       "q_group_size": 128,
       "w_bit": 4,
+      "version": "gemm"
     }
 }