Set use_cache to True, otherwise inference performance is poor (#2)

- Set use_cache to True, otherwise inference performance is poor (5e8c41ad549c0d528bceee10dad15b8dfb6feb38)


Co-authored-by: Tom Jobbins <TheBloke@users.noreply.huggingface.co>

config.json

@@ -19,6 +19,6 @@
   "tie_word_embeddings": false,
   "torch_dtype": "bfloat16",
   "transformers_version": "4.30.0.dev0",
-  "use_cache": false,
+  "use_cache": true,
   "vocab_size": 32000
 }