accelerate
bitsandbytes
torch
git+https://github.com/huggingface/transformers.git
einops
sentencepiece
mistral-inference==1.5.0