Run on cpu

#7
by sharjeel103 - opened

How can I run it on the CPU? This model uses Flash Attention, and I can't run it on either the CPU or the T4 GPU

Sign up or log in to comment