Can you do this to llama-3-8b?
#1
by
rombodawg
- opened
Is this possible to do to the 8b model while still making it able to be inferenced without making it generate gibberish?
So far no one has been able to prune 8b without ruining the model. Can you pull it off?
Can expect something in the next couple of weeks, Cheers!