Fix EOS token id
Browse filesThis change adjusts the eos_token_id to match an update to the original model. Here's the commit that updated the original model for reference:
https://huggingface.co/openchat/openchat-3.5-0106/commit/aa20a27ebc320797c96dd18ff596fe74df4b6e1d
I'm currently having to manually set the stop_token_ids in vllm in order get this model to terminate properly. I believe that this change will solve that issue.
- config.json +1 -1
config.json
CHANGED
@@ -5,7 +5,7 @@
|
|
5 |
],
|
6 |
"attention_dropout": 0.0,
|
7 |
"bos_token_id": 1,
|
8 |
-
"eos_token_id":
|
9 |
"hidden_act": "silu",
|
10 |
"hidden_size": 4096,
|
11 |
"initializer_range": 0.02,
|
|
|
5 |
],
|
6 |
"attention_dropout": 0.0,
|
7 |
"bos_token_id": 1,
|
8 |
+
"eos_token_id": 32000,
|
9 |
"hidden_act": "silu",
|
10 |
"hidden_size": 4096,
|
11 |
"initializer_range": 0.02,
|