BEE-spoke-data
/

smol_llama-101M-GQA-python

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

pszemraj commited on Oct 29, 2023

Commit

d2f824a

·

1 Parent(s): a75551d

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -16,9 +16,10 @@ inference:
   parameters:
     max_new_tokens: 48
     min_new_tokens: 8
-    num_beams: 4
     early_stopping: true
     repetition_penalty: 1.1
     renormalize_logits: true
 widget:
   - text: |

   parameters:
     max_new_tokens: 48
     min_new_tokens: 8
+    num_beams: 3
     early_stopping: true
     repetition_penalty: 1.1
+    no_repeat_ngram_size: 6
     renormalize_logits: true
 widget:
   - text: |