fastapi
uvicorn
transformers
torch
accelerate
duckduckgo-search
pydantic
bitsandbytes>=0.46.1
accelerate
sentencepiece