Hugging Face's logo

openlm-research
/
open_llama_3b

Text Generation
Transformers
PyTorch
llama
Inference Endpoints
text-generation-inference
Model card Files Community
12

Enable LlamaTokenizerFast and AutoTokenizer to load in seconds rather than 5 minutes.

#2
by danielhanchen - opened
base: refs/heads/main
←
from: refs/pr/2
Discussion Files changed
+96963
-0
Files changed (1) hide show
  1. tokenizer.json +0 -0
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff