Heh, manage to get DeepSeek-R1-Distill-Llama-8B to do function calling
using Tavily for search. It’s been tricky, at times it will “reason” out of choosing to do the web search despite a custom prompt telling to choose the web tool for real-time information. But so far so good.
Tavily has been a pleasure to work with. Super easy to setup and use. I’m loving it!
We’re happy to hear that you’ve managed to get DeepSeek-R1-Distill-Llama-8B working with Tavily for function calling! It’s great to know that Tavily has been such a smooth experience for you, it’s always exciting to see our clients making the most out of it!
If possible, would you be able to share your GitHub repo with us? We’d love to check it out and see how you’ve implemented everything!
PhippsAI is an experimental project that integrates local generative AI with real-time web search capabilities using function calling. Powered by DeepSeek R1, running locally via llama.cpp, and employs Tavily for live web searches. Usable from any language that supports win64/Unicode DLLs.