Tokenizer file missing

#2
by jatinarora - opened

Hello,

I do not see the tokenzier file that's required for text generation. Is this intentional?

Marketeam.AI org

Hi @jatinarora ! As noted in the How To Use Examples, you should use the microsoft/Phi-3-mini-128k-instruct tokenizer for this model.

Hmm. Thank you. I noticed that a little later. I am in the middle of figuring out why my sagemaker's notebook keep quitting when I try to run the model.

probably-not changed discussion status to closed

Sign up or log in to comment