Qwen
/

Qwen2-7B-Instruct-GPTQ-Int8

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

feihu.hf commited on Jun 10

Commit

c4ad2aa

•

1 Parent(s): 8dfcd82

update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -24,7 +24,7 @@
     "dataset": null,
     "desc_act": false,
     "exllama_config": {
-      "version": 1
     },
     "group_size": 128,
     "max_input_length": null,

     "dataset": null,
     "desc_act": false,
     "exllama_config": {
+      "version": 2
     },
     "group_size": 128,
     "max_input_length": null,