There is a bug with top p = 1 (thanks @lewtun ), so setting the max value to 0.99.

HuggingFaceM4 org

Note that you also need to bound top_p > 0 to avoid validation errors - sorry for not mentioning that before

HugoLaurencon changed pull request status to open
VictorSanh changed pull request status to merged

Sign up or log in to comment