Spaces:

ML610
/

replit-3b-ggml_models

Runtime error

ML610 commited on Jun 30, 2023

Commit

cca5ead

•

1 Parent(s): 2f89d92

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -33,7 +33,7 @@ def generate(
 ):
     """run model inference, will return a Generator if streaming is true"""
-    return llm(format_prompt(user_prompt), **asdict(generation_config))
 config = AutoConfig.from_pretrained(
     "teknium/Replit-v2-CodeInstruct-3B", context_length=2048

 ):
     """run model inference, will return a Generator if streaming is true"""
+    return next(llm(format_prompt(user_prompt), **asdict(generation_config)))["text"]
 config = AutoConfig.from_pretrained(
     "teknium/Replit-v2-CodeInstruct-3B", context_length=2048