使用langchain调用这个模型cpu一直100%没有结果
以下是模型收到的prompt输入：
Below is an instruction that describes a task. Write a response that appropriately completes the request. ### Instruction:
[{"lc":1,"type":"constructor","id":["langchain","schema","SystemMessage"],"kwargs":{"content":"The following is a friendly conversation between a human and an AI. The AI is talkative and provides lots of specific details from its context. If the AI does not know the answer to a question, it truthfully says it does not know.","additional_kwargs":{}}},{"lc":1,"type":"constructor","id":["langchain","schema","HumanMessage"],"kwargs":{"content":"美国有几个州","additional_kwargs":{}}}]
Response:
json是langchain生成的输出。
同样的输入使用vicuna-7b-v1.5.ggmlv3.q4_1.bin没有问题。
谢谢大佬分享量化模型。