brandon_powers_mcp_kafka

brandon_powers_mcp_kafka

by brandon-powers
An MCP server enabling language models to interact with Apache Kafka and its ecosystem.

Kafka Ecosystem MCP Server

Overview

mcp-kafka is a server-side implementation of the Model Context Protocol (MCP) for Apache Kafka. It enables language models (LLM/SLM) to interact reliably with Kafka and its ecosystem, including Kafka Connect, Burrow, and Cruise Control.

NOTE: This is a work in progress, and changes or potential errors are expected.

Features

The server supports capabilities based on the core Kafka APIs, excluding Streams (for now), along with the Burrow and Cruise Control REST APIs.

TODO

  • [ ] Use asyncio and aiohttp.
  • [ ] Set env config values in the data class.
  • [ ] Finish admin/consumer/producer API support.
  • [ ] Support Burrow API.
  • [ ] Support Cruise Control API.
  • [ ] Service + integration tests.
  • [ ] Publish to PyPI (uv pip install mcp-kafka).
  • [ ] Test Dockerfile & push to Dockerhub (docker pull bkpowers/mcp-kafka).
  • [ ] Usage/config/deployment options + demo in README.
  • [ ] Consider Strimzi/kcctl integrations.
  • [ ] Prompts with auto-complete support for certain resources/tools.

MCP Capabilities

Tools

Kafka
  • consume
  • produce
  • describe_kafka_cluster
  • describe_kafka_topics
  • describe_kafka_consumer_groups
  • describe_kafka_delegation_tokens
  • describe_kafka_log_dirs
  • describe_kafka_configs
  • describe_kafka_acls
Kafka Connect
  • get_kafka_connect_cluster_info
  • get_kafka_connect_config
  • get_kafka_connect_connectors
  • get_kafka_connect_connector_plugins
  • get_kafka_connect_loggers
Burrow
  • burrow_healthcheck
  • burrow_list_clusters
  • burrow_describe_cluster
  • burrow_list_consumers_with_group_detail
  • burrow_list_topics
  • burrow_check_consumer_group_status
Cruise Control
  • cruise_control_get_state
  • cruise_control_get_kafka_cluster_load
  • cruise_control_get_partition_resource_utilization_and_load
  • cruise_control_get_partition_and_replica_state
  • cruise_control_get_optimization_proposals
  • cruise_control_get_user_request_result

Resources

  • Topic, connector, consumer group

Prompts

Usage / Configuration

  1. Claude Desktop
  2. Cursor
  3. Windsurf
  4. Langchain MCP adapter
  5. Azure OpenAI

Environment Variables

Supported APIs are (currently) enabled by the presence of their specific environment variable. If none are present, the server responds as empty. If one or more variables are present, then the respective tools are also present.

  • KAFKA_BOOTSTRAP_SERVERS: Kafka Admin, Consumer, Producer APIs
  • KAFKA_CONNECT_API_URL: Kafka Connect API
  • KAFKA_BURROW_API_URL: Burrow API
  • KAFKA_CRUISE_CONTROL_API_URL: Cruise Control API

About

An MCP server for Apache Kafka & its ecosystem.

Resources

Readme

License

Apache-2.0 license

Activity

Stars

3 stars

Watchers

1 watching

Forks

0 forks

Report repository

Languages

Features & Capabilities

Categories
mcp_server model_context_protocol python kafka api_integration docker kafka_connect burrow cruise_control

Implementation Details

Stats

0 Views
0 Likes
3 GitHub Stars

Repository Info

brandon-powers Organization

Similar Servers

continuedev_continue by continuedev
0
0
0