scrapinghub/splash
Splash
Splash is a headless browser HTTP API and JavaScript rendering engine designed to convert dynamic web content into static HTML or images. It functions as a Lua-scriptable browser service that exposes browser automation and rendering capabilities through a RESTful interface for programmatic data extraction.
The service distinguishes itself by allowing the execution of custom Lua scripts to automate complex user interaction sequences and page navigation. It provides the ability to switch rendering engines on a per-request basis to verify cross-browser compatibility and visual consistency.
The platform covers a broad range of capabilities including automated web interaction through simulated keyboard and mouse events, as well as network traffic interception to monitor or modify requests and responses. It also supports DOM extraction using CSS selectors and the export of network logs for traffic analysis.
Features
- Headless Browser Automation - Implements a headless browser automation system for programmatically simulating user interactions and extracting data.
- Browser Automation APIs - Exposes browser automation and rendering capabilities via a stateless REST API for remote execution.
- JavaScript Rendering - Converts JavaScript-heavy websites into static HTML for programmatic data extraction.
- Web Page Rendering - Transforms dynamic web pages into static HTML, PNG, or JPEG files via an HTTP API.
- Embedded Lua Scripting - Integrates an embedded Lua engine to define custom interaction sequences and page logic.
- Lua Script Execution Environments - Executes custom Lua scripts to control browser behavior and automate complex interaction sequences.
- Browser Automation Scripts - Provides a Lua-scriptable environment to automate complex user interaction sequences and page navigation.
- Element Interaction - Simulates user input by sending keyboard events, performing mouse clicks, and filling out web forms.
- Headless Rendering Engines - Uses a headless rendering engine to execute JavaScript and generate final HTML or image snapshots.
- Web Automation Frameworks - Simulates user actions like clicking buttons and filling forms through a programmatic HTTP API.
- REST APIs - Exposes headless browser functions through a RESTful HTTP API for programmatic control and data extraction.
- Web Scraping - Extracts structured data from modern web applications by controlling a headless browser.
- CSS Selector - Provides CSS selectors to extract specific attributes and node content from the rendered DOM.
- Browser Screenshot Capture - Takes snapshots of full webpages or specific regions in common image formats for visual verification.
- Network Request Interceptors - Includes tools to monitor, modify, or block outgoing network requests and incoming responses.
- Traffic Interception Tools - Monitors or modifies outgoing requests and incoming responses to block resources based on headers.
- Network Traffic Logging - Provides the ability to capture and format network requests and responses for debugging page load sequences.
- Visual Consistency Testing - Enables visual verification of layout and consistency by capturing snapshots across different rendering engines.
- Data Extractions - Retrieves specific content from the rendered page using CSS selectors to access DOM node attributes.
- Network Request Interception - Monitors and modifies network traffic to block specific resources or capture detailed logs during page loads.
- Request-Browser Toggles - Allows switching between different rendering backends on a per-request basis to verify cross-browser compatibility.
- Browser Engines - Lightweight JavaScript rendering service with an HTTP API.
Star history
How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
