torch
trl 
scipy
transformers
git+https://github.com/huggingface/accelerate 
git+https://github.com/huggingface/peft.git
datasets 
bitsandbytes 
einops 
wandb