question about text-generation

#10
by sunzx0810 - opened

We meet an error 'list index out of range' while input question in local model, but it works well both on demo and text-generation webui, which is running the same code. I am very confused about it. I found that the answer will repeat the input question and it will also be counted in the token limits so as to raise error, But why does it work on webui or demo?

Sign up or log in to comment