cognitivess / cognitivess_model /tokenization_cognitivess.py
cognitivess's picture
Create tokenization_cognitivess.py
893a13c verified
raw
history blame
93 Bytes
from transformers import LlamaTokenizer
class CognitivessTokenizer(LlamaTokenizer):
pass