huggingface_hub==0.22.2
transformers
gradio
torch==2.2.2 torchvision==0.17.2 torchaudio==2.2.2 --index-url https://download.pytorch.org/whl/cpu
accelerate
bitsandbytes