Pyautogui

Features

Cross-Platform Desktop Automation Libraries - Provides a cross-platform library for simulating mouse and keyboard input to automate desktop tasks.
Desktop Automation Frameworks - Provides a comprehensive framework for automating complex desktop workflows using visual analysis and input simulation.
GUI Automation Libraries - Provides a Python library for programmatically controlling the mouse and keyboard to automate user interface interactions.
Keyboard Input Automation - Sends keystrokes and hotkey combinations to the active window to automate typing and commands.
Mouse Control Automation - Controls the mouse cursor movement and performs clicks or drag operations based on coordinates.
Input Simulators - The project's ability to position the cursor at specific or relative coordinates using precise clicks and easing movements.
Screen Capture Tools - Provides tools for taking snapshots of the monitor to drive automated software actions.
Pixel Analysis - Scans screen pixels to identify specific colors and patterns as triggers for automation.
Cross-Application Input Simulators - Injects simulated keyboard and mouse inputs into active desktop applications across different platforms.
Computer Vision Screen Interaction Tools - Analyzes screenshots using image pattern matching to locate elements and drive automation.
Input Simulations - Simulates keystrokes and mouse clicks to interact with applications that lack a formal API.
Visual Element Identification - Locates visual elements on the screen by searching for specific images or patterns.
Task Automation - Enables the scripting of complex click and typing sequences to automate routine computer workflows.
Runaway Script Prevention - Includes screen corner fail-safes and adjustable pauses to prevent automated scripts from running out of control.
Visual Testing - Implements automated visual scanning of the screen to verify that the user interface is displaying correctly.
Testing Frameworks - Cross-platform GUI automation for human interaction.
Testing Tools - Listed in the “Testing Tools” section of the Awesome Python awesome list.
Web and GUI Testing - Cross-platform GUI automation module.
Notes and Productivity - Cross-platform GUI automation.

Open-source alternatives to Pyautogui

Similar open-source projects, ranked by how many features they share with Pyautogui.

go-vgo/robotgo
go-vgo/robotgo
10,614View on GitHub
Robotgo is a cross-platform desktop automation framework for the Go programming language. It provides a comprehensive toolkit for programmatically interacting with graphical user interfaces, enabling developers to simulate human input, manage application windows, and monitor system-wide hardware events. The library distinguishes itself through its low-level system integration, utilizing a foreign function interface to interact directly with native operating system APIs. It employs pixel-buffer memory mapping and real-time screen capture to perform visual element identification, allowing for i
Goaiauto-testautomation
View on GitHub10,614
simular-ai/agent-s
simular-ai/Agent-S
11,855View on GitHub
Agent-S is a multimodal AI agent and LLM desktop automation framework designed to control operating systems through graphical user interface interactions. It functions as a computer use interface, utilizing vision-language grounding to translate natural language goals into precise screen coordinates and system actions. The project differentiates itself by combining structured accessibility tree inspection with vision-based element localization. It manages cross-application workflows by mapping conceptual descriptions to physical pixels and simulating low-level keyboard and mouse events to mov
Pythonagent-computer-interfaceai-agentscomputer-automation
View on GitHub11,855
octalmage/robotjs
octalmage/robotjs
12,740View on GitHub
Robotjs is a native Node.js automation library and desktop input simulator. It uses C++ bindings to provide low-level access to operating system functions, allowing for the programmatic control of the mouse and keyboard and the analysis of screen pixels. The library functions as a toolkit for automating user interfaces and desktop workflows, including those within Electron applications. It enables the simulation of key presses and mouse movements to automate interactions with desktop software and perform automated data entry. Its capabilities extend to screen pixel analysis, where it capture
C
View on GitHub12,740
bytebot-ai/bytebot
bytebot-ai/bytebot
10,413View on GitHub
Bytebot is an LLM desktop automation framework and virtual Linux desktop environment. It enables AI agents to plan and execute mouse and keyboard actions on a virtual computer using natural language, allowing for autonomous desktop automation and the integration of legacy systems that lack native APIs. The system operates as an LLM API gateway and a Model Context Protocol server, routing requests across multiple language model providers with integrated load balancing and rate limiting. It provides isolated, containerized environments where agents use visual reasoning to interpret screenshots
TypeScriptagentagentic-aiagents
View on GitHub10,413

See all 30 alternatives to Pyautogui

asweigartpyautogui

Features

Open-source alternatives to Pyautogui

go-vgo/robotgo

simular-ai/Agent-S

octalmage/robotjs

bytebot-ai/bytebot

Star history

Open-source alternatives to Pyautogui

go-vgo/robotgo

simular-ai/Agent-S

octalmage/robotjs

bytebot-ai/bytebot