ArthurZ HF staff sanchit-gandhi HF staff commited on
Commit
f0a02de
1 Parent(s): e5ea493

Allow single quotes "'" and hyphens "-" (#2)

Browse files

- Allow single quotes "'" and hyphens "-" (523f7db29d28c53cf8446d008efbaea2595baa1c)


Co-authored-by: Sanchit Gandhi <sanchit-gandhi@users.noreply.huggingface.co>

Files changed (1) hide show
  1. config.json +0 -2
config.json CHANGED
@@ -42,12 +42,10 @@
42
  "suppress_tokens": [
43
  1,
44
  2,
45
- 6,
46
  7,
47
  8,
48
  9,
49
  10,
50
- 12,
51
  14,
52
  25,
53
  26,
 
42
  "suppress_tokens": [
43
  1,
44
  2,
 
45
  7,
46
  8,
47
  9,
48
  10,
 
49
  14,
50
  25,
51
  26,