OpenGPT-4o_new

Paused

KingNish commited on Jul 11, 2024

Commit

d8174c2

verified ·

1 Parent(s): d5d46ba

Update chatbot.py

Files changed (1) hide show

chatbot.py CHANGED Viewed

@@ -325,7 +325,7 @@ def model_inference(
                     output += response.token.text
                 yield output
         else:
-            client = InferenceClient("mistralai/Mixtral-8x7B-Instruct-v0.1")
             generate_kwargs = dict(
                 max_new_tokens=5000,
                 do_sample=True,

                     output += response.token.text
                 yield output
         else:
+            client = InferenceClient("mistralai/Mistral-7B-Instruct-v0.3")
             generate_kwargs = dict(
                 max_new_tokens=5000,
                 do_sample=True,