hf-qa-demo

Running on A10G

KonradSzafer commited on Feb 15

Commit

5195c5a

•

1 Parent(s): 22d6d1d

changed temperature

Files changed (1) hide show

qa_engine/qa_engine.py CHANGED Viewed

@@ -81,7 +81,7 @@ class TransformersPipelineModel(LLM):
             pad_token_id=tokenizer.eos_token_id,
             min_new_tokens=64,
             max_new_tokens=800,
-            temperature=0.5,
             do_sample=True,
         )

             pad_token_id=tokenizer.eos_token_id,
             min_new_tokens=64,
             max_new_tokens=800,
+            temperature=0.1,
             do_sample=True,
         )