250880 embedding size but tokenizer is size 250002...

#4
by manu - opened

250880 embedding size but tokenizer is size 250002... Is there a reason ?

Sign up or log in to comment