My brain hurts trying to figure this out? Which one should I use for this? (Using Text-Generation-Webui + SillyTavern)
Thank you.
Q2_K but with most of it offloaded.. you probably don't want to run this unless you don't care about speed
· Sign up or log in to comment