Transformers
GGUF
llama

I have a question

#2
by Kyouko-Hatake - opened

I would like to be able to launch my own GGUF or other model directly with python without using Webui, is this possible?

Maybe this example, can help you out.
https://github.com/machaao/mistral-7b-chatbot

Sign up or log in to comment