torch==2.1.2
nm-vllm[sparse]==0.1.0
gradio