Weblet
/

Llama-2-7b-chat-hf-ct2-int8

Text Generation

text-generation-inference

Model card Files Files and versions Community

Weblet commited on Apr 30

Commit

17a40e1

•

1 Parent(s): dbfd7f4

Update config.json

Files changed (1) hide show

config.json +1 -0

config.json CHANGED Viewed

@@ -3,6 +3,7 @@
     "architectures": [
         "LlamaForCausalLM"
     ],
     "bos_token_id": 1,
     "eos_token_id": 2,
     "hidden_act": "silu",

     "architectures": [
         "LlamaForCausalLM"
     ],
+    "weights_only": false,
     "bos_token_id": 1,
     "eos_token_id": 2,
     "hidden_act": "silu",