OverflowError: out of range integral type conversion attempted

#3
by bimal1109 - opened

I'm using "razent/SciFive-large-Pubmed_PMC" for 2 class classification task. But while decoding I'm getting this error.
Error: OverflowError: out of range integral type conversion attempted
I tried to replace the -100 tokens where I got the error(given below) but then it decodes to some random words or characters.

if data_args.ignore_pad_token_for_loss:
# Replace -100 in the labels as we can't decode them.
preds = np.where(preds != -100, preds, tokenizer.pad_token_id)

image.png

Sign up or log in to comment