Local-Novel-LLM-project
/

Vecteus-v1

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

umisetokikaze commited on May 4

Commit

a74d9e2

•

1 Parent(s): 88fdb98

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -70,7 +70,7 @@ system_prompt = "あなたはプロの小説家です。\n小説を書いてく
 prompt = input("Enter a prompt: ")
 system_prompt += prompt + "\n-------- "
-model_inputs = tokenizer([prompt], return_tensors="pt").to("cuda")
 generated_ids = model.generate(**model_inputs, max_new_tokens=new_tokens, do_sample=True)

 prompt = input("Enter a prompt: ")
 system_prompt += prompt + "\n-------- "
+model_inputs = tokenizer([system_prompt], return_tensors="pt").to("cuda")
 generated_ids = model.generate(**model_inputs, max_new_tokens=new_tokens, do_sample=True)