doberst commited on
Commit
7441ad9
·
1 Parent(s): 3156d80

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -6
README.md CHANGED
@@ -113,12 +113,6 @@ If you are using a HuggingFace generation script:
113
 
114
  output_only = tokenizer.decode(outputs[0][start_of_output:],skip_special_tokens=True)
115
 
116
- # note: due to artifact of the fine-tuning, use this post-processing with HF generation
117
-
118
- eot = output_only.find("<|endoftext|>")
119
- if eot > -1:
120
- output_only = output_only[:eot]
121
-
122
 
123
  ## Model Card Contact
124
 
 
113
 
114
  output_only = tokenizer.decode(outputs[0][start_of_output:],skip_special_tokens=True)
115
 
 
 
 
 
 
 
116
 
117
  ## Model Card Contact
118