可以增加tokenizer.json吗？

by navy985 - opened 29 days ago

29 days ago

•

可以增加tokenizer.model对应的tokenzier.json文件吗？或者如何生成？

navy985 changed discussion title from 可以增加tokenzier.json吗？ to 可以增加tokenizer.json吗？ 29 days ago

czczup

OpenGVLab org 29 days ago

可以啊，这个是新版的transformers会生成的吗，我看看怎么弄

25 days ago

尝试生成tokenizer.json，报错：

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment