"no entry found for key" Error
#15
by
mber
- opened
Hi!
I tried using the model, but got the "no entry found for key" error message.
It seems that the vocabulary size of 50313, but the output projection is up to 51200.
When I looked at the predictions of the model, I indeed got tokens such as index 50906.
Is there going to be a fix for this?
Where did you find the vocab size of 50313? Could you provide us with an example snippet that produced the error? Thanks!
When using the tokenizer, I get the following:
In the model's config, the vocab_size is 51200:
Then, during decoding, a token of 50906 was generated, causing the error:
