Facing issues with awq inference engine while Finetuning idefics2-8b-AWQ
#3
by
Bharanidharan07
- opened
Hi Folks,
I tried to Finetune idefics2-8b-AWQ model but unfortunately i encountered
this error "ImportError: /usr/local/lib/python3.10/dist-packages/awq_inference_engine.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZN3c104cuda9SetDeviceEi" so i tried installing awq inference engine but pypi doesnt have awq inference engine package so i tried downloading from a third party and done a setup but still i landed on that same error, can someone help me with this?
Bharanidharan07
changed discussion title from
Facing issues with awq inference engine
to Facing issues with awq inference engine while Finetuning idefics2-8b-AWQ