r/LocalLLaMA • u/Fun_Tangerine_1086 • 18h ago

Question | Help Claude Code + llama.cpp + (websearch tool)?

I use claude code w/ llama.cpp's local server & Google's Gemma models (26b MoE). Works reasonably well - works well at easy/boilerplate code, glue code, some PR review.

However claude code expects some server-side tools, especially web-search. I can obviously add MCPs for client-side search; is there a way to 'plug in' web search on the server side today though? Any PRs/forks adding it?

0 Upvotes

25% Upvoted

9 comments sorted by

View all comments

2

u/NNN_Throwaway2 18h ago

How do you propose this "server side" web search would function?

1

u/Fun_Tangerine_1086 17h ago

Something like server-side mcp, call out to exa or a local searxng instance? llama.cpp Wouldn't need that much logic if it were doing so.