Blender Open MCP with Ollama Integration

blender-open-mcp is an open-source project that integrates Blender with local AI models (via Ollama) using the Model Context Protocol (MCP). This allows you to control Blender using natural language prompts, leveraging the power of AI to assist with 3D modeling tasks.

Features

• Control Blender with Natural Language: Send prompts to a locally running Ollama model to perform actions in Blender.
• MCP Integration: Uses the Model Context Protocol for structured communication between the AI model and Blender.
• Ollama Support: Designed to work with Ollama for easy local model management.
• Blender Add-on: Includes a Blender add-on to provide a user interface and handle communication with the server.
• PolyHaven Integration (Optional): Download and use assets (HDRIs, textures, models) from PolyHaven directly within Blender via AI prompts.
• Basic 3D Operations:
• Get Scene and Object Info
• Create Primitives
• Modify and delete objects
• Apply materials
• Render Support: Render images using the tool and retrieve information based on the output.

Installation

Prerequisites

1. Blender: Blender 3.0 or later. Download from blender.org.
2. Ollama: Install from ollama.com, following OS-specific instructions.
3. Python: Python 3.10 or later.
4. uv: Install using pip install uv.
5. Git: Required for cloning the repository.

Installation Steps

1. Clone the Repository:
   shell git clone https://github.com/dhakalnirajan/blender-open-mcp.git cd blender-open-mcp
2. Create and Activate a Virtual Environment (Recommended):
   shell uv venv source .venv/bin/activate # On Linux/macOS .venv\Scripts\activate # On Windows
3. Install Dependencies:
   shell uv pip install -e .
4. Install the Blender Add-on:
5. Open Blender.
6. Go to Edit -> Preferences -> Add-ons.
7. Click Install....
8. Select the addon.py file from the blender-open-mcp directory.
9. Enable the "Blender MCP" add-on.
10. Download an Ollama Model (if not already installed):
    shell ollama run llama3.2
    (Other models like Gemma3 can also be used.)

Setup

1. Start the Ollama Server: Ensure Ollama is running in the background.
2. Start the MCP Server:
   shell blender-mcp
   Or,
   shell python src/blender_open_mcp/server.py
   By default, it listens on http://0.0.0.0:8000, but you can modify settings:
   shell blender-mcp --host 127.0.0.1 --port 8001 --ollama-url http://localhost:11434 --ollama-model llama3.2
3. Start the Blender Add-on Server:
4. Open Blender and the 3D Viewport.
5. Press N to open the sidebar.
6. Find the "Blender MCP" panel.
7. Click "Start MCP Server".

Usage

Interact with blender-open-mcp using the mcp command-line tool:

Example Commands

• Basic Prompt:
  shell mcp prompt "Hello BlenderMCP!" --host http://localhost:8000
• Get Scene Information:
  shell mcp tool get_scene_info --host http://localhost:8000
• Create a Cube:
  shell mcp prompt "Create a cube named 'my_cube'." --host http://localhost:8000
• Render an Image:
  shell mcp prompt "Render the image." --host http://localhost:8000
• Using PolyHaven (if enabled):
  shell mcp prompt "Download a texture from PolyHaven." --host http://localhost:8000

Available Tools

Troubleshooting

If you encounter issues:

• Ensure Ollama and the blender-open-mcp server are running.
• Check Blender’s add-on settings.
• Verify command-line arguments.
• Refer to logs for error details.

For further assistance, visit the GitHub Issues page.

Happy Blending with AI! 🚀

About

Open Models MCP for Blender Using Ollama

Topics

python blender3d blender mcp blender-addon model-context-protocol mcp-server

Resources

Readme

License

View license

Stars

6 stars

Watchers

2 watching

Forks

1 fork

Report repository

Languages

• Python 100.0%