Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
RANITBAG
/
CustomAItokenizer
like
0
Model card
Files
Files and versions
Community
main
CustomAItokenizer
/
added_tokens.json
RANITBAG
Upload tokenizer
4ae2dfb
8 months ago
raw
history
blame
contribute
delete
No virus
55 Bytes
{
"<|endoftext|>"
:
1001
,
"<|startoftext|>"
:
1000
}