fix(modeling): use correct `base_model_prefix` name fa88b77 verified jon-tow commited on Jan 29, 2024
fix: make `eos_token`/`pad_token` overridable and add `pickle` support 589adbf verified jon-tow commited on Jan 23, 2024
feat(tokenizer): expose merge ranks and special tokens for GGUF 33c3426 verified jon-tow commited on Jan 19, 2024
Rename README.md to update(code): fix tokenizer loading 67dc96c verified reciprocate commited on Jan 19, 2024