MCP-PyAutoGUI-Server provides automated GUI testing and control capabilities through a Python-based interface. Developed by He Tao, this server wraps the PyAutoGUI library to enable AI assistants to control mouse movements, simulate keyboard input, take screenshots, and find images on screen across Windows, macOS, and Linux. The implementation offers tools for precise cursor positioning, clicking, typing text, pressing hotkeys, and screen analysis through a standardized protocol. It's particularly useful for automating repetitive GUI tasks, creating test scripts, or allowing AI systems to interact directly with desktop applications through visual interfaces.
Aucun avis encore. Soyez le premier à donner votre avis !
Connectez-vous pour rejoindre la conversation
Highlight AIMove mouse to specific coordinates. Parameters: x (int), y (int)
Click at current or specified position. Parameters: position (optional tuple)
Perform drag and drop operations. Parameters: start_position (tuple), end_position (tuple)
Get the current mouse position.
Type text. Parameters: text (string)
Press individual keys. Parameters: key (string)
Perform hotkey combinations. Parameters: keys (list of strings)
Take screenshots.
Get screen size.
Find image locations on screen. Parameters: image (string)
Get pixel colors at specified coordinates. Parameters: x (int), y (int)
