Error while loading the model
#1
by
kitkatdafu
- opened
I got the following error while I was trying to load the model
OSError: Can't load tokenizer for 'CarperAI/openai_summarize_tldr_sft'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure 'CarperAI/openai_summarize_tldr_sft' is the correct path to a directory containing all relevant files for a GPT2TokenizerFast tokenizer.
using
tokenizer = AutoTokenizer.from_pretrained("CarperAI/openai_summarize_tldr_sft")
model = AutoModelForCausalLM.from_pretrained("CarperAI/openai_summarize_tldr_sft")
Should I use
tokenizer = AutoTokenizer.from_pretrained("EleutherAI/gpt-j-6b")
as the tokenizer?