Hugging Face's logo

Qwen
/
Qwen-tokenizer

Model card Files Community
1

🚩 Report

#1
by cjzx - opened
Discussion
cjzx

My code:

tokenizer = AutoTokenizer.from_pretrained('../Qwen-tokenizer', trust_remote_code=True)
...

Error:
ValueError: Tokenizer class Qwen2Tokenizer does not exist or is not currently imported.

Is this repo not working?

PPrimo
 Qwen org

Please update the latest version of transformers.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment