Chat template issues with newer llama.cpp?
#9
by
aaron-newsome
- opened
Just curious what's happened with the chat template issues when running in llama.cpp. It was stable for quite a while but now I get failed tool calls frequently and weird messages in the logs, like
Template supports tool calls but does not natively describe tools. The fallback behaviour used may produce bad results, inspect prompt w/ --verbose & consider overriding the template.
Is this an issue with the chat template built in to the GGUF or is this a result of the new llama.cpp autoparser? Just seeing if anyone has a solution.