UI Explorer MCP Server

@modularflow

About UI Explorer MCP Server

MCP Server for tools to explore the UI on your computer.

Config

Add this server to your MCP-compatible client using the configuration below.

{
  "mcpServers": {
    "mcp-ui-explorer": {
      "command": "python",
      "args": [
        "record_macro.py",
        "--name",
        "Login Workflow"
      ]
    }
  }
}

Tools

No tools detected

We auto-extract tools from the README. The maintainer can list them under a ## Tools heading to populate this section.

Overview

What is UI Explorer MCP Server?

UI Explorer MCP Server is an MCP server that provides tools for exploring and interacting with UI elements on your screen. It is designed for developers and testers who need to automate UI workflows on Windows.

How to use UI Explorer MCP Server?

Install the package via pip install mcp-ui-explorer or clone the repository. Then, configure your MCP client (e.g., Roo in Cursor or Claude Desktop) with the server command uvx mcp-ui-explorer. Use the provided MCP tools like explore_ui, screenshot_ui, and click_ui_element to scan and control UI elements.

Key features of UI Explorer MCP Server

Explore UI hierarchies across screen regions
Take screenshots with highlighted UI boundaries
Click at screen coordinates programmatically
Send keyboard input and shortcuts
Record and playback UI workflows as macros

Use cases of UI Explorer MCP Server

Automating repetitive UI tasks on Windows
Debugging and verifying UI layouts during development
Recording and replaying multi-step user workflows

FAQ from UI Explorer MCP Server

What operating system does UI Explorer MCP Server support?

Windows.

How do I install UI Explorer MCP Server?

Use pip install mcp-ui-explorer or clone the repository and install in development mode with pip install -e . or uv pip install -e ..

How do I record and playback macros?

Run python record_macro.py --name "My Workflow" to record and python play_macro.py --file "macros/My Workflow.json" to playback. Windows users can use the provided batch files.

What tools does UI Explorer MCP Server provide?

explore_ui, screenshot_ui, click_ui_element, and keyboard_input.

What are the runtime requirements for UI Explorer MCP Server?

Python 3.10+, MCP 1.6.0+, PyAutoGUI, PyWinAuto, Pillow, and Pydantic 2.0+.

Frequently asked questions

What operating system does UI Explorer MCP Server support?

Windows.

How do I install UI Explorer MCP Server?

Use `pip install mcp-ui-explorer` or clone the repository and install in development mode with `pip install -e .` or `uv pip install -e .`.

How do I record and playback macros?

Run `python record_macro.py --name "My Workflow"` to record and `python play_macro.py --file "macros/My Workflow.json"` to playback. Windows users can use the provided batch files.

What tools does UI Explorer MCP Server provide?

`explore_ui`, `screenshot_ui`, `click_ui_element`, and `keyboard_input`.

What are the runtime requirements for UI Explorer MCP Server?

Python 3.10+, MCP 1.6.0+, PyAutoGUI, PyWinAuto, Pillow, and Pydantic 2.0+.

Comments

Basic information

More Other MCP servers

EverArt

modelcontextprotocol

Model Context Protocol Servers

88.1K

Blender

ahujasid

Open-source MCP to use Blender with any LLM

23.6K

YOUB

Connect your AI assistant to your own YOUB endurance training account. Read recorded activities with full analysis, planned sessions, race goals, wellness (HRV, sleep, resting HR) and your athletic profile. Create or mov

ICSS

chokcoco

不止于 CSS

20.7K

MCP Registry

modelcontextprotocol

A community driven registry service for Model Context Protocol (MCP) servers.

7.0K