Crumb
c/localllama · by variety4me@lemmy.zip · 182d

llama.cpp + mcp - docker and more

i have the following mcps configured:

  1. mcp-server-time
  2. duckduckgo-mcp-server
  3. mcp-server-fetch
  4. mcp-searxng
  5. mcp-server-docker

I run on a laptop with an iGPU but 32GB ram, llama.cpp is compiled for cpu only, the machine crawls at executing these tasks but works perfectly, the model is Qwen3.5-9B

14 points · 2 comments · view on lemmy.world

2 Comments

angrywaffle@piefed.social · 1 pts · 178d (1 reply)

Is it safe to use the mcp-server-docker and web search together in llama.cpp webui? Since it doesn't ask for permission before running tools, I'm worried about malicious search results injecting commands

variety4me@lemmy.zip · 1 pts · 176d

mcp-searxng - run your own searxng instance and connect to it