Starling-LM-7B-alpha-GGUF

Runtime error

limcheekin commited on Nov 27, 2023

Commit

7fca658

•

1 Parent(s): 4e50e86

feat: added chat_format

Files changed (1) hide show

main.py CHANGED Viewed

@@ -6,7 +6,8 @@ app = create_app(
     Settings(
         n_threads=2,  # set to number of cpu cores
         model="model/gguf-model.bin",
-        embedding=True
     )
 )

     Settings(
         n_threads=2,  # set to number of cpu cores
         model="model/gguf-model.bin",
+        embedding=True,
+        chat_format="openchat"
     )
 )