Felladrin commited on
Commit
697456e
·
1 Parent(s): c360bdf

Set `add_special_tokens` inference parameter to `true`

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -61,6 +61,7 @@ widget:
61
  <|im_start|>assistant
62
  inference:
63
  parameters:
 
64
  max_new_tokens: 250
65
  penalty_alpha: 0.5
66
  top_k: 5
@@ -94,6 +95,7 @@ The recommended prompt format is as follows:
94
  To get the best results, prefer using [contrastive search](https://huggingface.co/docs/transformers/main/en/generation_strategies#contrastive-search) for inference:
95
 
96
  ```yml
 
97
  penalty_alpha: 0.5
98
  top_k: 5
99
  ```
 
61
  <|im_start|>assistant
62
  inference:
63
  parameters:
64
+ add_special_tokens: true
65
  max_new_tokens: 250
66
  penalty_alpha: 0.5
67
  top_k: 5
 
95
  To get the best results, prefer using [contrastive search](https://huggingface.co/docs/transformers/main/en/generation_strategies#contrastive-search) for inference:
96
 
97
  ```yml
98
+ add_special_tokens: true
99
  penalty_alpha: 0.5
100
  top_k: 5
101
  ```