Token limit
#6
by
alihkhawaher
- opened
Hello,
Is there a token limit on the model? because I am getting an error if I am close to or over 150 tokens
Please advice
alihkhawaher
changed discussion title from
Long context
to Token limit
I also got a relevant error: RuntimeError: shape '[4, 252, 13653]' is invalid for input of size 13773312 when loading it in 8 bits and trying to fine-tune it.
Any ideas would be appreciated!