ceadar-ie
/

FinanceConnect-13B

Text Generation

domain specific llm

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

ceadar-ie commited on Nov 28, 2023

Commit

6cd8d29

·

1 Parent(s): 595982b

Update README.md

Files changed (1) hide show

README.md +3 -2

README.md CHANGED Viewed

@@ -84,8 +84,9 @@ def generate_text(input_text):
     start_time = time.time()
-    pipe = pipeline(task="text-generation", model=model, tokenizer=tokenizer, max_length=1000,temperature=1)
-    prompt = f" <s>[INST] {input_text} [/INST]"
     result = pipe(prompt)
     generated_text = result[0]['generated_text'].replace(prompt, "").strip()

     start_time = time.time()
+    pipe = pipeline(task="text-generation", model=model, tokenizer=tokenizer, max_length = 1000)
+    prompt = f"<s>[INST] {input_text} [/INST]"
+    #prompt = input_text
     result = pipe(prompt)
     generated_text = result[0]['generated_text'].replace(prompt, "").strip()