infinitimeless_lmstudio_mcp

infinitimeless_lmstudio_mcp

by infinitimeless
Enables Claude to interact with locally running LLM models via LM Studio using a Model Control Protocol (MCP) server.

Claude-LMStudio Bridge via MCP Server

Screenshot

Overview

LMStudio-MCP creates a bridge between Claude (with MCP capabilities) and your locally running LM Studio instance. This allows Claude to:

  • Check the health of your LM Studio API
  • List available models
  • Get the currently loaded model
  • Generate completions using your local models

This enables you to leverage your own locally running models through Claude's interface, combining Claude's capabilities with your private models.

Prerequisites

  • Python 3.7+
  • LM Studio installed and running locally with a model loaded
  • Claude with MCP access
  • Required Python packages (see Installation)

Installation

  1. Clone this repository:

    shell git clone https://github.com/infinitimeless/LMStudio-MCP.git cd LMStudio-MCP

  2. Install the required packages:

    shell pip install requests "mcp[cli]" openai

MCP Configuration

For Claude to connect to this bridge, you need to configure the MCP settings properly. You can either:

  1. Use directly from GitHub:

    json { "lmstudio-mcp": { "command": "uvx", "args": [\ "https://github.com/infinitimeless/LMStudio-MCP"\ ] } }

  2. Use local installation:

    json { "lmstudio-mcp": { "command": "/bin/bash", "args": [\ "-c",\ "cd /path/to/LMStudio-MCP && source venv/bin/activate && python lmstudio_bridge.py"\ ] } }

For detailed MCP configuration instructions, see MCP_CONFIGURATION.md.

Usage

  1. Start your LM Studio application and ensure it's running on port 1234 (the default)
  2. Load a model in LM Studio

  3. If running locally (not using uvx), run the LMStudio-MCP server:

    shell python lmstudio_bridge.py

  4. In Claude, connect to the MCP server when prompted by selecting "lmstudio-mcp"

Available Functions

The bridge provides the following functions:

  • health_check(): Verify if LM Studio API is accessible
  • list_models(): Get a list of all available models in LM Studio
  • get_current_model(): Identify which model is currently loaded
  • chat_completion(prompt, system_prompt, temperature, max_tokens): Generate text from your local model

Known Limitations

  • Some models (e.g., phi-3.5-mini-instruct_uncensored) may have compatibility issues
  • The bridge currently uses only the OpenAI-compatible API endpoints of LM Studio
  • Model responses will be limited by the capabilities of your locally loaded model

Troubleshooting

API Connection Issues

If Claude reports 404 errors when trying to connect to LM Studio:

  • Ensure LM Studio is running and has a model loaded
  • Check that LM Studio's server is running on port 1234
  • Verify your firewall isn't blocking the connection
  • Try using "127.0.0.1" instead of "localhost" in the API URL if issues persist

Model Compatibility

If certain models don't work correctly:

  • Some models might not fully support the OpenAI chat completions API format
  • Try different parameter values (temperature, max_tokens) for problematic models
  • Consider switching to a more compatible model if problems persist

For more detailed troubleshooting help, see TROUBLESHOOTING.md.

License

MIT

Acknowledgements

This project was originally developed as "Claude-LMStudio-Bridge_V2" and has been renamed and open-sourced as "LMStudio-MCP".

Features & Capabilities

Categories
mcp_server model_context_protocol python claude lm_studio api_integration local_models

Implementation Details

View on GitHub

Stats

0 Views
5 GitHub Stars

Repository Info

infinitimeless Organization

Similar MCP Servers

continuedev_continue by continuedev
25049
cherryhq_cherry_studio by CherryHQ
21423
bytedance_ui_tars_desktop by bytedance
9300
2025© BestAI