Change cache = true in config.json to significantly boost inference performance (#1)

- Change cache = true in config.json to significantly boost inference performance (b8eb946dbe5e6c538e6c6abd54af67700f57d630)


Co-authored-by: Tom Jobbins <TheBloke@users.noreply.huggingface.co>

config.json

@@ -19,6 +19,6 @@
   "tie_word_embeddings": false,
   "torch_dtype": "bfloat16",
   "transformers_version": "4.30.0.dev0",
-  "use_cache": false,
+  "use_cache": true,
   "vocab_size": 32000
 }