:boom: [Fix] Remove whole token which ends with stop_sequences 2d7c092 Hansimov commited on Jun 25, 2024
:pencil: [Config] Update requirements.txt with sentencepiece and aa6ccf1 Hansimov commited on Jun 25, 2024
:boom: [Fix] slow tokenizer issue, and finish by stop_sequences 8697de8 Hansimov commited on Jun 25, 2024
:zap: [Enhance] Add new model yi-1.5-34b, and remove unavailable models b9a642a Hansimov commited on Jun 25, 2024