Set `add_special_tokens` inference parameter to `true`
Browse files
README.md
CHANGED
@@ -61,6 +61,7 @@ widget:
|
|
61 |
<|im_start|>assistant
|
62 |
inference:
|
63 |
parameters:
|
|
|
64 |
max_new_tokens: 250
|
65 |
penalty_alpha: 0.5
|
66 |
top_k: 5
|
@@ -94,6 +95,7 @@ The recommended prompt format is as follows:
|
|
94 |
To get the best results, prefer using [contrastive search](https://huggingface.co/docs/transformers/main/en/generation_strategies#contrastive-search) for inference:
|
95 |
|
96 |
```yml
|
|
|
97 |
penalty_alpha: 0.5
|
98 |
top_k: 5
|
99 |
```
|
|
|
61 |
<|im_start|>assistant
|
62 |
inference:
|
63 |
parameters:
|
64 |
+
add_special_tokens: true
|
65 |
max_new_tokens: 250
|
66 |
penalty_alpha: 0.5
|
67 |
top_k: 5
|
|
|
95 |
To get the best results, prefer using [contrastive search](https://huggingface.co/docs/transformers/main/en/generation_strategies#contrastive-search) for inference:
|
96 |
|
97 |
```yml
|
98 |
+
add_special_tokens: true
|
99 |
penalty_alpha: 0.5
|
100 |
top_k: 5
|
101 |
```
|