requirements.txt

git+https://github.com/huggingface/transformers.git
--extra-index-url https://download.pytorch.org/whl/cu113
torch
git+https://github.com/vllm-project/vllm.git
datasets
accelerate
numpy
ochat