ArthurZ HF staff sanchit-gandhi HF staff commited on
Commit
6866d59
1 Parent(s): c60f6aa

Allow single quotes "'" and hyphens "-" (#2)

Browse files

- Allow single quotes "'" and hyphens "-" (e2c101c33bb8cb33915ea296d953c8d004f9bf37)


Co-authored-by: Sanchit Gandhi <sanchit-gandhi@users.noreply.huggingface.co>

Files changed (1) hide show
  1. config.json +0 -2
config.json CHANGED
@@ -42,12 +42,10 @@
42
  "suppress_tokens": [
43
  1,
44
  2,
45
- 6,
46
  7,
47
  8,
48
  9,
49
  10,
50
- 12,
51
  14,
52
  25,
53
  26,
 
42
  "suppress_tokens": [
43
  1,
44
  2,
 
45
  7,
46
  8,
47
  9,
48
  10,
 
49
  14,
50
  25,
51
  26,