Tokenizer of this version is not compatible with the original.

#13
by suhcrates - opened

tokenizer for 'open_llama_3b' is not compatible with the original one "meta-llama/Llama-2-7b".

Sign up or log in to comment