rudr4sarkar commited on
Commit
f9d875d
·
verified ·
1 Parent(s): 1da9451

Update requirements.txt

Browse files

it will ensure the SentencePiece tokenizer library is available for the LlamaTokenizer to use.

Files changed (1) hide show
  1. requirements.txt +2 -1
requirements.txt CHANGED
@@ -4,4 +4,5 @@ transformers>=4.36.0
4
  peft
5
  bitsandbytes>=0.41.0
6
  accelerate
7
- safetensors
 
 
4
  peft
5
  bitsandbytes>=0.41.0
6
  accelerate
7
+ safetensors
8
+ sentencepiece