Hallucinating function calls

#26
by SebastianS - opened

trace:

prompt text:
 <s>[INST]▁What's▁the▁weather▁and▁rain▁probability▁today▁in▁Paris?[/INST][TOOL_CALLS]▁[{"name":▁"get_current_weather",▁"arguments":▁{"location":▁"Paris,▁FR",▁"format":▁"celsius"},▁"id":▁"abc456789"}]</s>[TOOL_RESULTS]▁{"content":▁{"temperature":▁20,▁"unit":▁"celsius"},▁"call_id":▁"abc456789"}[/TOOL_RESULTS]▁The▁weather▁in▁Paris▁is▁20▁degrees▁celsius.</s>[AVAILABLE_TOOLS]▁[{"type":▁"function",▁"function":▁{"name":▁"get_current_weather",▁"description":▁"Get▁the▁current▁weather",▁"parameters":▁{"type":▁"object",▁"properties":▁{"location":▁{"type":▁"string",▁"description":▁"The▁city▁and▁state,▁e.g.▁San▁Francisco,▁CA"},▁"format":▁{"type":▁"string",▁"enum":▁["celsius",▁"fahrenheit"],▁"description":▁"The▁temperature▁unit▁to▁use.▁Infer▁this▁from▁the▁users▁location."}},▁"required":▁["location",▁"format"]}}}][/AVAILABLE_TOOLS][INST]▁What▁should▁I▁wear▁under▁those▁conditions?[/INST]


Decoded tokens:
 What's the weather and rain probability today in Paris? [{"name": "get_current_weather", "arguments": {"location": "Paris, FR", "format": "celsius"}, "id": "abc456789"}] {"content": {"temperature": 20, "unit": "celsius"}, "call_id": "abc456789"} The weather in Paris is 20 degrees celsius. [{"type": "function", "function": {"name": "get_current_weather", "description": "Get the current weather", "parameters": {"type": "object", "properties": {"location": {"type": "string", "description": "The city and state, e.g. San Francisco, CA"}, "format": {"type": "string", "enum": ["celsius", "fahrenheit"], "description": "The temperature unit to use. Infer this from the users location."}}, "required": ["location", "format"]}}}] What should I wear under those conditions?


Tokenization time:
0.021461963653564453 seconds


Generation time
: 13.436598777770996 seconds


out_tokens:
 [[5, 1501, 7567, 1629, 2032, 1113, 1295, 29498, 1035, 2573, 3276, 29498, 1280, 5950, 1316, 1113, 17452, 2032, 10598, 29475, 17329, 2032, 29473, 29518, 29502, 29493, 1113, 6074, 2032, 1113, 29485, 1958, 3938, 29507, 1743, 29561]]


Result:
 [{"name": "get_recommended_clothing", "arguments": {"temperature": 20, "unit": "celsius"}}]

Sign up or log in to comment