cognitivess / cognitivess_model /tokenization_cognitivess_fast.py
cognitivess's picture
Rename cognitivess_model/tokenization_Cognitivess_fast.py to cognitivess_model/tokenization_cognitivess_fast.py
980a0c2 verified
raw
history blame contribute delete
190 Bytes
from transformers import PreTrainedTokenizerFast
class CognitivessTokenizerFast(PreTrainedTokenizerFast):
def __init__(self, *args, **kwargs):
super().__init__(*args, **kwargs)