Setting vocab_size to solve the issue of mlc-chat module not initalizing
Browse filesSolves the issue of vocab_size requirement when initializing ChatModule()
TVMError: Check failed: (partial_update) is false: Key "vocab_size" not found.
params/mlc-chat-config.json
CHANGED
@@ -13,5 +13,6 @@
|
|
13 |
"tokenizer.json"
|
14 |
],
|
15 |
"model_category": "llama",
|
16 |
-
"model_name": "Llama-2-13b-chat-omniquant"
|
|
|
17 |
}
|
|
|
13 |
"tokenizer.json"
|
14 |
],
|
15 |
"model_category": "llama",
|
16 |
+
"model_name": "Llama-2-13b-chat-omniquant",
|
17 |
+
"vocab_size": 32000
|
18 |
}
|