Error when loading in HuggingFace
#2
by
vasileion
- opened
I get the following error when trying to setup as HF endpoint:
ImportError: cannot import name 'ExllamaQuantLinear' from 'text_generation_server.layers.gptq'
Any idea?
No idea, sorry. I don't try to load these in Huggingface since I load my stuff in Oobabooga.