Daedalus_1 / tokenizer_confkg.json
Or4cl3-1's picture
Create tokenizer_confkg.json
6caec2c verified
raw
history blame
178 Bytes
{
"model_type": "encoder-decoder",
"vocab_size": 50257,
"bos_token_id": 50256,
"eos_token_id": 50256,
"unk_token_id": 1,
"pad_token_id": 0,
"mask_token_id": 50256
}