torch
sentence-transformers
auto-gptq
optimum