multimodal / transformers /utils /test_module /custom_tokenization.py
Li
add transformers
455a40f
raw
history blame
88 Bytes
from transformers import BertTokenizer
class CustomTokenizer(BertTokenizer):
pass