gradio
accelerate
gguf
transformers
torch
sentencepiece