The attention mask and the pad token id were not set

by hamidpalangi - opened May 24

Microsoft org May 24

Hi,

Thanks for the wonderful work here! I am able to run "Phi-3-medium-128k-instruct" with no issues but when I try "Phi-3-small-128k-instruct" for the same input I receive the warning The attention mask and the pad token id were not set. As a consequence, you may observe unexpected behavior. Please pass your input's attention_mask to obtain reliable results. and then the model generates null in the output. Any idea how to fix this?

Thanks!
-Hamid

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment