OSError: gpt2 does not appear to have a file named config.json. Checkout 'https://huggingface.co/gpt2/None' for available files.

#98

by Iust1n2 - opened Jul 11

Discussion

Iust1n2

Jul 11

I'm using AutoTokenizer.from_pretrained("gpt2") with transformers Version: 4.35.2 and tokenizers Version: 0.15.0

johnoshaughnessy22

Jul 15

Try:

tokenizer = GPT2Tokenizer.from_pretrained(model_name
config = GPT2Config.from_pretrained(model_name)
model = GPT2LMHeadModel.from_pretrained(model_name, config=config)
model.to(device)

I dont believe the AutoTokenizer is supported

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment