Load our local mode

#8
by pa3lo - opened

Is it possible to run a local model (.gguf)?
I would like to evaluate aya23 and similar models

UONLP org
edited Jul 18

Hi. This leaderboard uses https://github.com/EleutherAI/lm-evaluation-harness
I am unaware of whether lm_eval_harness has supported the .gguf format.
Please double check the https://github.com/EleutherAI/lm-evaluation-harness.

Sign up or log in to comment