Spaces:

yhavinga
/

dutch-tokenizer-arena

Runtime error

App Files Files Community

dutch-tokenizer-arena / requirements.txt

xu-song's picture

add olmo tokenizer

bbefe94 8 months ago

72 Bytes

	transformers
	sentencepiece
	tiktoken
	icetk
	torch
	zhon
	nltk
	boto3
	ai2-olmo