Spaces:
Running
on
A10G
Running
on
A10G
no gpu
#119
by
goodasdgood
- opened
it is not work on gpu
GPU is only used to generate imatrix. Quantization is CPU-only operation in llama.cpp
ngxson
changed discussion status to
closed