iyanello
/

openchat_3.5-q4f16_1-mlc-llm

Model card Files Files and versions

iyanello commited on Dec 27, 2023

Commit

7d4d4cb

•

1 Parent(s): de46d76

Update added_tokens.json

Files changed (1) hide show

added_tokens.json +1 -0

added_tokens.json CHANGED Viewed

@@ -1,4 +1,5 @@
 {
   "<|end_of_turn|>": 32000,
   "<|pad_0|>": 32001
 }

 {
   "<|end_of_turn|>": 32000,
+  "<|endoftext|>": 50256,
   "<|pad_0|>": 32001
 }