model returned the prompt template as the answer
#27
by
Jingni393
- opened
I used the template listed in the model card, but sometimes it returns the prompt instructions as answers. Does anyone have ideas how to handle this?
answer_template_str = """ System:
You're a knowledgeable assistant.
Your job is to answer questions about given documents.
{context}
User: {question}
Assistant:
"""
Am I using it wrong?
I don't know if I'm using this wrong either, but it seems to like to answer like as if the roles are swapped all too often - it pretends like as if you are the assistant, and it's asking you the questions.