ValueError: Tokenizer class GemmaTokenizer does not exist or is not currently imported.

#14
by xahilmalik - opened

Load model directly

from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("google/gemma-2b")
model = AutoModelForCausalLM.from_pretrained("google/gemma-2b")

Wired getting this error while loading the model "ValueError: Tokenizer class GemmaTokenizer does not exist or is not currently imported."

xahilmalik changed discussion status to closed

Sign up or log in to comment