I am interested in learning quantization of microsoft's Phi models and would like to know how you did it. I tried, got errors and gave up half-way through.Also, is it possible to quantize in AWQ?
· Sign up or log in to comment
