runtime error

won't be available and only tokenizers, configuration and file/data utilities can be used. tokenizer_config.json: 0%| | 0.00/1.70k [00:00<?, ?B/s] tokenizer_config.json: 100%|██████████| 1.70k/1.70k [00:00<00:00, 11.7MB/s] tokenizer.model: 0%| | 0.00/493k [00:00<?, ?B/s] tokenizer.model: 100%|██████████| 493k/493k [00:00<00:00, 94.1MB/s] added_tokens.json: 0%| | 0.00/51.0 [00:00<?, ?B/s] added_tokens.json: 100%|██████████| 51.0/51.0 [00:00<00:00, 366kB/s] special_tokens_map.json: 0%| | 0.00/443 [00:00<?, ?B/s] special_tokens_map.json: 100%|██████████| 443/443 [00:00<00:00, 2.61MB/s] Traceback (most recent call last): File "/home/user/app/app.py", line 6, in <module> tokenizer = AutoTokenizer.from_pretrained(model_id) File "/home/user/.local/lib/python3.10/site-packages/transformers/models/auto/tokenization_auto.py", line 787, in from_pretrained return tokenizer_class.from_pretrained(pretrained_model_name_or_path, *inputs, **kwargs) File "/home/user/.local/lib/python3.10/site-packages/transformers/tokenization_utils_base.py", line 2028, in from_pretrained return cls._from_pretrained( File "/home/user/.local/lib/python3.10/site-packages/transformers/tokenization_utils_base.py", line 2260, in _from_pretrained tokenizer = cls(*init_inputs, **init_kwargs) File "/home/user/.local/lib/python3.10/site-packages/transformers/models/llama/tokenization_llama_fast.py", line 124, in __init__ super().__init__( File "/home/user/.local/lib/python3.10/site-packages/transformers/tokenization_utils_fast.py", line 120, in __init__ raise ValueError( ValueError: Couldn't instantiate the backend tokenizer from one of: (1) a `tokenizers` library serialization file, (2) a slow tokenizer instance to convert or (3) an equivalent slow tokenizer class to instantiate and convert. You need to have sentencepiece installed to convert a slow tokenizer to a fast one.

Container logs: