browser-use/browser-harness
Browser Harness
This project is an automation framework that connects large language models to web browsers via the Chrome DevTools Protocol for autonomous task execution. It functions as a bridge between intelligent agents and browser engines, allowing for the direct control of browser sessions and profiles.
The framework features a self-healing agent capable of generating and executing custom scripts during runtime to resolve failures and optimize browser tasks. It supports stealthy deployment through the use of integrated proxies and captcha solvers to bypass bot detection and security mitigations.
The system covers a wide range of capabilities including cloud-based headless browser management, remote session orchestration via authentication keys, and page state inspection through combined visual and DOM analysis. It also provides mechanisms for integrating site-specific logic and pre-defined skills from local workspaces to increase task reliability.
Features
- Agentic Browser Controllers - Functions as the primary bridge between an intelligent agent and a web browser for autonomous task completion.
- LLM-Driven Automation - Connects large language models to web browsers for autonomous navigation and complex task execution.
- Dynamic Helper Generation - Generates and executes custom scripts during runtime to overcome failures and optimize browser automation tasks.
- Browser Automation Agents - Acts as an intelligent agent capable of interacting with web browsers to complete autonomous tasks.
- Self-Improving Automation Code - Enables a self-healing agent to write and execute new code to resolve failures and improve future task success.
- DOM State Inspection - Combines coordinate-based screenshots with DOM analysis to extract real-time page data and interface layouts.
- Dynamic Automation Helper Generation - Synthesizes new automation functions during runtime to overcome complex browser task requirements.
- Dynamic Automation Helper Generation - Allows the system to create and execute custom scripts at runtime to resolve failures and optimize browser tasks.
- Element Interaction - Simulates user actions including coordinate-based clicks, iframe management, and page scrolling.
- Page State Analysis - Analyzes the current DOM and visual state of a page to inform autonomous agent decision-making.
- LLM-Driven Frameworks - Provides a framework where large language models determine the interaction sequences for browser automation.
- Browser Automation - Provides a comprehensive framework for controlling headless browsers to perform autonomous web interactions.
- LLM Browser Connectivity - Provides the essential connectivity layer that allows language models to execute tasks via direct browser control.
- Chrome DevTools Protocols - Utilizes the Chrome DevTools Protocol for bidirectional communication and low-level control of the browser engine.
- DevTools Protocol Clients - Functions as a DevTools Protocol client to manage browser sessions, profiles, and page interactions.
- Skill Directory Configurations - Loads site-specific logic and pre-defined automation primitives from local directories to increase task reliability.
- Browser Protocol Controllers - Allows the direct transmission of low-level CDP commands to the browser engine for advanced control.
- Stealth Headless Instance Management - Deploys invisible browser sessions with integrated proxy support and automated captcha solving to avoid detection.
- Bot Detection Bypass - Employs techniques to mimic legitimate human behavior and bypass automated bot detection systems.
- Site-Specific Skill Integration - Increases task reliability by loading site-specific logic and pre-defined skills from local workspaces.
- Stealth Configurations - Deploys browser sessions with integrated proxies and captcha solvers to bypass bot detection and security mitigations.
- Remote Browser Infrastructure Management - Orchestrates the deployment and scaling of headless browser instances in cloud environments.
- Session Orchestration Tools - Manages the lifecycle and isolation of concurrent headless browser sessions on cloud servers.
- Custom Automation Primitive Extensions - Supports the development of custom scripts in local workspaces to build new browser automation primitives.
- Cloud Browser Integrations - Bridges local LLM environments to remote cloud-hosted browser sessions using authentication keys.
- Headless Browser Orchestrators - Orchestrates isolated headless browser instances on cloud servers for background tasks and data extraction.
- Remote Browser Connections - Implements interfaces to initialize and connect to remote cloud-hosted browser instances using authentication keys.
