metadata
library_name: transformers
base_model: openai-community/gpt2
license: apache-2.0
language:
- en
GPT-2, But With Mistral's Tokenizer
Finally, an answer to one of the biggest open questions in NLP:
Q: Wouldn't it be messed up if someone grafted the tokenizer from Mistral 7B onto GPT-2?
A: Ya :)