ValueError: Tokenizer class YiTokenizer does not exist or is not currently imported.
#1
by
cheesyFishes
- opened
It seems like the tokenizer is not added to huggingface? I have installed from the main branch in source.
Is there another branch to install from?
Hi ! I would recommend two steps - (1) update your version of transformers to 4.34 or 4.35, and (2) add "trust_remote_code" = True in the tokenizer load. Please let me know if those steps fix this issue.
Yea that fixed it, thanks!
cheesyFishes
changed discussion status to
closed