When I wanted to load this model, AutoModelForCausalLM.from_pretrained() cannot load model, but use AutoAWQForCausalLM can do this.I recommend to use AutoAWQForCausalLM, and want to ask why this happen?
· Sign up or log in to comment
