"Can't load tokenizer" Error
#1
by
mlaney
- opened
Hi, I'm trying to load this model, but the AutoTokenizer.from_pretrained() method is throwing the following error:
OSError: Can't load tokenizer for 'usail-hkust/JailJudge-guard'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure 'usail-hkust/JailJudge-guard' is the correct path to a directory containing all relevant files for a LlamaTokenizerFast tokenizer.
Am I missing a step? Or is the tokenizer not part of this model page?
mlaney
changed discussion status to
closed
mlaney
changed discussion status to
open
The tokenizer is set to LLaMA-2-7B; you may also use this tokenizer if needed.
qqqwt
changed discussion status to
closed