kevineen
/

llm-jp-3-13b-finetune

Text Generation

Model card Files Files and versions Community

kevineen commited on 11 days ago

Commit

9476967

•

1 Parent(s): 14edb2b

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -443,7 +443,7 @@ for data in tqdm(datasets):
       outputs = model.generate(
           tokenized_input,
           attention_mask=attention_mask,
-          max_new_tokens=100,
           do_sample=False,
           repetition_penalty=1.2,
           pad_token_id=tokenizer.eos_token_id

       outputs = model.generate(
           tokenized_input,
           attention_mask=attention_mask,
+          max_new_tokens=1024,
           do_sample=False,
           repetition_penalty=1.2,
           pad_token_id=tokenizer.eos_token_id