YingxuHe
/

chatglm3-6b-chitchat

Inference Endpoints

Model card Files Files and versions Community

Yingxu He commited on Oct 29

Commit

7e813b1

•

1 Parent(s): 3c8df2b

Update handler.py

Files changed (1) hide show

handler.py +2 -2

handler.py CHANGED Viewed

@@ -42,8 +42,8 @@ class EndpointHandler:
         # pass inputs with all kwargs in data
         if parameters is not None:
-            prediction = self.pipeline.chat(messages, **parameters)
         else:
-            prediction = self.pipeline.chat(messages)
         # postprocess the prediction
         return prediction.content

         # pass inputs with all kwargs in data
         if parameters is not None:
+            prediction = self.pipeline.chat(cpp_messages, **parameters)
         else:
+            prediction = self.pipeline.chat(cpp_messages)
         # postprocess the prediction
         return prediction.content