NickyNicky
/

gemma-2b-it_oasst2_chatML_Cluster_2_V1

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

NickyNicky commited on Feb 23

Commit

1552940

•

1 Parent(s): accf573

Update README.md

Files changed (1) hide show

README.md +4 -1

README.md CHANGED Viewed

@@ -168,7 +168,10 @@ What is the meaning of life in the current time?<end_of_turn>
 <start_of_turn>model
 """
-inputs = tokenizer.encode(txt, return_tensors="pt").to("cuda")
 max_new_tokens=1000
 generation_config = GenerationConfig(
               max_new_tokens=max_new_tokens,

 <start_of_turn>model
 """
+inputs = tokenizer.encode(txt,
+                          return_tensors="pt",
+                          add_special_tokens=False).to("cuda:0")
 max_new_tokens=1000
 generation_config = GenerationConfig(
               max_new_tokens=max_new_tokens,