MCP-PyAutoGUI-Server provides automated GUI testing and control capabilities through a Python-based interface. Developed by He Tao, this server wraps the PyAutoGUI library to enable AI assistants to control mouse movements, simulate keyboard input, take screenshots, and find images on screen across Windows, macOS, and Linux. The implementation offers tools for precise cursor positioning, clicking, typing text, pressing hotkeys, and screen analysis through a standardized protocol. It's particularly useful for automating repetitive GUI tasks, creating test scripts, or allowing AI systems to interact directly with desktop applications through visual interfaces.
아직 리뷰가 없습니다. 첫 번째 리뷰를 작성해 보세요!
대화에 참여하려면 로그인하세요
Move mouse to specific coordinates. Parameters: x (integer), y (integer)
Click at current or specified position. Parameters: position (optional tuple of integers)
Perform drag and drop operations. Parameters: start_position (tuple of integers), end_position (tuple of integers)
Get current mouse position. Returns: (x, y) coordinates as a tuple
Type text using the keyboard. Parameters: text (string)
Press individual keys on the keyboard. Parameters: key (string)
Simulate hotkey combinations. Parameters: keys (list of strings)
Take a screenshot of the current screen. Returns: image data
Get the size of the screen. Returns: (width, height) as a tuple
Find image locations on the screen. Parameters: image_path (string), confidence (optional float)
Get the color of a specific pixel. Parameters: x (integer), y (integer)
