ultrafunkamsterdam/nodriver
Nodriver
nodriver is an asynchronous Chromium browser automation framework that provides headless control and web scraping capabilities. It functions as a Chrome DevTools Protocol client, allowing for granular engine control by attaching directly to the browser's debug port without the need for external driver binaries.
The framework is specifically designed as an anti-bot detection bypass tool. It modifies browser fingerprints and protocol headers to evade automated security systems, handle security warnings, and bypass common obstacles like insecure connection alerts.
The system covers a broad range of automation capabilities, including user input simulation, element discovery via CSS selectors or image matching, and custom JavaScript execution. It also provides session management for cookie persistence, network event monitoring, and tools for capturing page content through screenshots and video.
Features
- Anti-Bot Evasion - Evades bot detection systems by mimicking browser fingerprints and headers to bypass security services.
- Browser Automation - An asynchronous framework for controlling Chromium-based browsers to perform web scraping and automation.
- Browser Automation Frameworks - Functions as an asynchronous framework for controlling Chromium browsers without requiring external driver binaries.
- Driverless Browser Integrations - Controls the browser engine by attaching directly to its debug port instead of using a middleman binary like ChromeDriver.
- Script Execution Contexts - Injects and evaluates custom JavaScript directly within the browser's execution context to manipulate the DOM.
- Session-Cookie Persistences - Maintains authenticated states by serializing and reloading cookies and browser profile data from local storage.
- UI Element Interactions - Automates direct user actions such as clicking, typing, dragging, and scrolling on specific page elements.
- DOM Element Selectors - Finds elements using CSS selectors and text matches to target specific page components for automation.
- JavaScript Execution Bridges - Executes arbitrary JavaScript code within the browser context and returns the results to the automation script.
- Browser Session Persistence - Implements mechanisms for maintaining and reusing authenticated browser sessions to avoid repeated login procedures.
- Headless Browser Controllers - Controls headless browser instances to execute JavaScript and simulate human interactions.
- Chrome DevTools Protocols - Provides deep integration with Chrome DevTools Protocols for bidirectional communication and browser control.
- DevTools Protocol Clients - Functions as a direct client for the Chrome DevTools Protocol to control the browser without external binaries.
- Browser Session Managers - Manages browser profiles and cookies to persist authenticated states across automation sessions.
- Web Scraping - Collects structured data from websites by simulating user interactions and executing JavaScript.
- Browser Protocol Controllers - Allows the execution of raw, low-level CDP commands for granular control beyond standard automation APIs.
- Human-Mimetic Input Simulations - Simulates human-like interactions, including mouse movement and keyboard input, to avoid bot detection.
- Element Presence Retries - Automatically polls the browser state until requested elements appear to handle dynamic content loading.
- Asynchronous Event Loops - Implements an asynchronous event-driven execution model to handle concurrent browser events without blocking.
- SSL Warning Bypasses - Automatically bypasses invalid SSL certificate warnings to maintain automation on insecure connections.
- Page State Captures - Saves browser page states as screenshots or video recordings for documentation and behavior verification.
- Iframe Navigators - Provides the ability to locate and interact with elements nested inside iframes and shadow DOMs.
- Network Traffic Monitors - Registers callbacks to monitor and react to real-time network traffic and requests within the browser.
- Visual Element Locators - Locates page elements by analyzing pixel patterns through screenshots when CSS selectors are unavailable.
- Image-Based - Finds the coordinates of elements using image matching to locate items hidden from the document object model.
- Browser Session Management - Provides programmatic control over browser tabs, including opening, closing, and navigating page history.
- Web Automation Frameworks - Provides a framework for building scripts that automate complex web-based workflows and interactions.
- Browser Dialog and Event Handlers - Registers callback functions to intercept and respond to specific browser events and UI states.
