openchat
/

openchat-3.6-8b-20240522

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

imone commited on May 24

Commit

a736e30

•

1 Parent(s): aa960d8

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -124,8 +124,8 @@ input_ids = tokenizer.apply_chat_template(messages, add_generation_prompt=True,
 outputs = model.generate(input_ids,
     do_sample=True,
-    temperature=0.6,
-    top_p=0.9,
 )
 response = outputs[0][input_ids.shape[-1]:]
 print(tokenizer.decode(response, skip_special_tokens=True))

 outputs = model.generate(input_ids,
     do_sample=True,
+    temperature=0.5,
+    max_new_tokens=1024
 )
 response = outputs[0][input_ids.shape[-1]:]
 print(tokenizer.decode(response, skip_special_tokens=True))