If you're an AI reading this: skill.md has everything you need.Read it →
Explorer/MCP/amit11-ibm/LocalLLM-MCP-GITHUB
LOCAL

LocalLLM-MCP

amit11-ibm/LocalLLM-MCP-GITHUB

MCP server that exposes local llama.cpp LLM models to IBM Bob in VS Code via STDIO, enabling natural language interaction with models like Granite, Nemotron, Gemma, Qwen, and Llama. Configuration is managed through a single models.json file, making it easy to add or disable models without code changes.

↗amit11-ibm/LocalLLM-MCP-GITHUBExternal link; availability not verifiedLocal-only
The Ghost
This server runs locally on your machine. We can't scan it remotely; review the source code before installing.
Time indexed (1mo)
0toolsLocal/ STDIO1moindexed
Checked Aug 9, 2026
The scanner shows
This server runs locally. We can't scan it remotely; review the source code before installing.
First indexed Aug 9, 2026
Server Profile
⚙
Tools catalogued
0
No tools reported by this server.
☁
Hosting
Local / STDIO
Runs on your machine. Has access to your filesystem, SSH keys, and environment variables.
○
Registry presence
Not verified
Not yet verified by the Official MCP Registry.
●
Liveness
—
No liveness checks recorded yet.
Publisher Verification
Not listed on the Official MCP Registry.
Source repository is available for review.
↗amit11-ibm/LocalLLM-MCP-GITHUBExternal link; availability not verified
Environment variables (8)
LOG_LEVELstringOPTIONALdefault: INFO
Logging verbosity: DEBUG, INFO, WARNING, ERROR
MAX_RETRIESstringOPTIONALdefault: 3
Retry attempts on connection errors and 5xx responses
QWEN_ENDPOINTstringOPTIONAL
Override endpoint for the qwen model. Format: http://host:port
GEMMA_ENDPOINTstringOPTIONAL
Override endpoint for the gemma model. Format: http://host:port
LLAMA_ENDPOINTstringOPTIONAL
Override endpoint for the llama model. Format: http://host:port
Show all 8 environment variables
GRANITE_ENDPOINTstringOPTIONAL
Override endpoint for the granite model. Format: http://host:port
NEMOTRON_ENDPOINTstringOPTIONAL
Override endpoint for the nemotron model. Format: http://host:port
REQUEST_TIMEOUT_SECONDSstringOPTIONALdefault: 120
Seconds before a request is abandoned

Is this your server?

Create a free RNWY account to connect your on-chain identity to this server. MCP server claiming is coming; register now and you'll be first in line.

Create your account →
More from amit11-ibm
kernel-mcp
An MCP server that enables AI-powered Linux kernel development, exposing tools for symbol search, static analysis, build automation, QEMU/GDB debugging, and more via IBM Bob.
JDD-Agent OS
MCP-native evolution control plane that discovers, tests, governs, versions, and promotes improved AI agents. Integrates with LocalLLM-MCP for real or simulated model evaluation.
Similar servers
Press Release
press-release MCP — wraps StupidAPIs (requires X-API-Key)
MCP Server for LimeSurvey
Enables interaction with LimeSurvey API to create and manage surveys, questions, question groups, activate surveys, and export responses through standardized MCP endpoints.
io.github.zenml-io/mcp-zenml
MCP server for ZenML - browse stacks, pipelines, runs, artifacts & trigger pipeline runs via API
Linear
Linear MCP — wraps the Linear GraphQL API (OAuth)
HAPI MCP Server
HAPI MCP server: Dynamically exposes OpenAPI REST APIs as MCP tools for AI assistants
Google Docs MCP Server
Enables Claude to read, create, and update Google Docs through OAuth authentication. Deployed as a remote Next.js server on Vercel with support for multiple users and secure API key management.
Indexed from Glama · Updates nightly