frankenmerger
/

MiniLlama-1.8b-Chat-v0.1

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

gmonsoon commited on Mar 13

Commit

a880960

•

1 Parent(s): 1ca262b

Update README.md

Files changed (1) hide show

README.md +4 -2

README.md CHANGED Viewed

@@ -45,8 +45,10 @@ widget:
 inference:
   parameters:
     max_new_tokens: 256
-    penalty_alpha: 0.5
-    top_k: 4
 base_model:
 - TinyLlama/TinyLlama-1.1B-Chat-v1.0
 license: apache-2.0

 inference:
   parameters:
     max_new_tokens: 256
+    temperature: 0.6
+    top_p: 0.95
+    top_k: 50
+    repetition_penalty: 1.2
 base_model:
 - TinyLlama/TinyLlama-1.1B-Chat-v1.0
 license: apache-2.0