octalmage/robotjs
Robotjs
Robotjs is a native Node.js automation library and desktop input simulator. It uses C++ bindings to provide low-level access to operating system functions, allowing for the programmatic control of the mouse and keyboard and the analysis of screen pixels.
The library functions as a toolkit for automating user interfaces and desktop workflows, including those within Electron applications. It enables the simulation of key presses and mouse movements to automate interactions with desktop software and perform automated data entry.
Its capabilities extend to screen pixel analysis, where it captures screen visuals and reads individual pixel colors to monitor the state of a display. These features facilitate GUI testing automation by verifying visual results through screen snapshots.
Features
- Mouse Automation - Programmatically simulates cursor movements and click events to automate interactions with desktop applications.
- Desktop Application Automation - A toolkit for automating user interfaces within Electron applications by recompiling native modules for the shell runtime.
- Pixel-Buffer Memory Mapping - Directly reads screen memory addresses to retrieve pixel color data and capture display snapshots.
- Pixel Analyzers - Inspects pixel-level color data to monitor and detect visual changes on the display.
- Keyboard Input Automation - Simulates key presses and types text strings to automate data entry and command execution.
- Mouse Control Automation - Moves the cursor to specific coordinates and performs clicks or drag-and-drop actions.
- Screen Capture Utilities - Captures screen regions and snapshots to verify visual states or locate specific images.
- Input Event Simulation - Injects synthetic input events into the system queue to simulate hardware mouse and keyboard activity.
- Cross-Application Input Simulators - Simulates keyboard and mouse input to automate interactions across various desktop applications.
- Desktop Automation - Automates repetitive user tasks and workflows across the local desktop operating system.
- Native C Interoperability - Provides native C++ bindings to allow Node.js to interact directly with low-level operating system APIs.
- Desktop Automation Libraries - A set of native bindings for simulating keyboard and mouse input and reading screen pixels within a Node.js environment.
- Node.js Native Addons - Implements a native Node.js addon using C++ bindings for low-level access to OS input and display functions.
- Input-Based Data Entry - Uses programmed keystrokes and mouse movements to transfer information between desktop applications.
- Pixel Analysis - Provides the ability to capture screen visuals and read individual pixel colors to monitor display states for automation.
- Native Module Recompilers - Allows recompiling native modules to ensure binary compatibility with the Electron desktop shell runtime.
- Cross-Platform Abstractions - Abstracts divergent Windows, macOS, and Linux system calls into a single unified JavaScript interface.
- User Interaction Simulation - Replicates human input and analyzes screen pixels to verify GUI visual results during testing.
- Electron Application Automation - Controlling desktop applications built with Electron by simulating input events and managing native module binaries.
- Automation & RPA - Desktop automation for Node.js.
- Automation Tools - Desktop automation for mouse and keyboard control.
