OpenAssistant
/

falcon-40b-megacode2-oasst

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

andreaskoepf commited on Aug 17, 2023

Commit

9ccce4f

•

1 Parent(s): 8dd7749

Update special_tokens_map.json

Files changed (1) hide show

special_tokens_map.json +11 -0

special_tokens_map.json CHANGED Viewed

@@ -1,5 +1,16 @@
 {
   "additional_special_tokens": [
     "<|im_start|>",
     "<|im_end|>"
   ],

 {
   "additional_special_tokens": [
+    ">>TITLE<<",
+    ">>ABSTRACT<<",
+    ">>INTRODUCTION<<",
+    ">>SUMMARY<<",
+    ">>COMMENT<<",
+    ">>ANSWER<<",
+    ">>QUESTION<<",
+    ">>DOMAIN<<",
+    ">>PREFIX<<",
+    ">>SUFFIX<<",
+    ">>MIDDLE<<",
     "<|im_start|>",
     "<|im_end|>"
   ],