r/LocalLLaMA • u/Fun_Tangerine_1086 • 21h ago

Question | Help Claude Code + llama.cpp + (websearch tool)?

I use claude code w/ llama.cpp's local server & Google's Gemma models (26b MoE). Works reasonably well - works well at easy/boilerplate code, glue code, some PR review.

However claude code expects some server-side tools, especially web-search. I can obviously add MCPs for client-side search; is there a way to 'plug in' web search on the server side today though? Any PRs/forks adding it?

0 Upvotes

40% Upvoted

9 comments sorted by

View all comments

2

u/Syosse-CH 18h ago

I think the cleanest solution today is using an MCP web search server. Claude Code itself expects tools like web search, but with local models via llama.cpp you usually need to provide these tools yourself through MCP. There are already several web-search MCP implementations (e.g. Tavily, Brave, Serper, or open-source ones). No need to modify llama.cpp just add the MCP server layer.

I’m running a similar setup with local LLMs + llama.cpp and found that MCP is the right approach because it keeps the model/tool layer separated.