transformers @ git+https://github.com/huggingface/transformers
replicate
auto_gptq