Update tokenizer_config.json

#3
by ayyylol - opened

Hi failspy,

The official Llama-3-Instruct updated this, do you think we should update it here too?
Reference: https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct/commit/a8977699a3d0820e80129fb3c93c20fbd9972c41

Thank you for the hard work!

Cognitive Computations org

Hey, thanks! Next version was going to be updated with this, appreciate you creating this PR to get this version updated.

failspy changed pull request status to merged

Sign up or log in to comment