Text Generation
Transformers
PyTorch
Safetensors
English
hf_olmo
custom_code
OLMo-1B / tokenization_olmo_fast.py
akshitab's picture
initial files
932c85d
raw
history blame
61 Bytes
from hf_olmo.tokenization_olmo_fast import OLMoTokenizerFast