torch
transformers
gradio
fastapi
uvicorn
pydantic
accelerate>=0.26.0