scrapinghub/splash
Splash
Splash este un API HTTP de browser headless și un motor de randare JavaScript conceput pentru a converti conținutul web dinamic în HTML static sau imagini. Funcționează ca un serviciu de browser scriptabil în Lua care expune capabilități de automatizare și randare a browserului printr-o interfață RESTful pentru extragerea programatică a datelor.
Serviciul se distinge prin faptul că permite executarea de scripturi Lua personalizate pentru a automatiza secvențe complexe de interacțiune cu utilizatorul și navigarea pe pagini. Oferă posibilitatea de a comuta motoarele de randare per cerere pentru a verifica compatibilitatea cross-browser și consistența vizuală.
Platforma acoperă o gamă largă de capabilități, inclusiv interacțiunea web automatizată prin evenimente simulate de tastatură și mouse, precum și interceptarea traficului de rețea pentru a monitoriza sau modifica cererile și răspunsurile. De asemenea, suportă extragerea DOM folosind selectori CSS și exportul jurnalelor de rețea pentru analiza traficului.
Features
- Headless Browser Automation - Implements a headless browser automation system for programmatically simulating user interactions and extracting data.
- Browser Automation APIs - Exposes browser automation and rendering capabilities via a stateless REST API for remote execution.
- JavaScript Rendering - Converts JavaScript-heavy websites into static HTML for programmatic data extraction.
- Web Page Rendering - Transforms dynamic web pages into static HTML, PNG, or JPEG files via an HTTP API.
- Embedded Lua Scripting - Integrates an embedded Lua engine to define custom interaction sequences and page logic.
- Lua Script Execution Environments - Executes custom Lua scripts to control browser behavior and automate complex interaction sequences.
- Browser Automation Scripts - Provides a Lua-scriptable environment to automate complex user interaction sequences and page navigation.
- Element Interaction - Simulates user input by sending keyboard events, performing mouse clicks, and filling out web forms.
- Headless Rendering Engines - Uses a headless rendering engine to execute JavaScript and generate final HTML or image snapshots.
- Web Automation Frameworks - Simulates user actions like clicking buttons and filling forms through a programmatic HTTP API.
- REST APIs - Exposes headless browser functions through a RESTful HTTP API for programmatic control and data extraction.
- Web Scraping - Extracts structured data from modern web applications by controlling a headless browser.
- CSS Selector - Provides CSS selectors to extract specific attributes and node content from the rendered DOM.
- Browser Screenshot Capture - Takes snapshots of full webpages or specific regions in common image formats for visual verification.
- Network Request Interceptors - Includes tools to monitor, modify, or block outgoing network requests and incoming responses.
- Traffic Interception Tools - Monitors or modifies outgoing requests and incoming responses to block resources based on headers.
- Network Traffic Logging - Provides the ability to capture and format network requests and responses for debugging page load sequences.
- Visual Consistency Testing - Enables visual verification of layout and consistency by capturing snapshots across different rendering engines.
- Data Extractions - Retrieves specific content from the rendered page using CSS selectors to access DOM node attributes.
- Network Request Interception - Monitors and modifies network traffic to block specific resources or capture detailed logs during page loads.
- Request-Browser Toggles - Allows switching between different rendering backends on a per-request basis to verify cross-browser compatibility.
- Browser Engines - Lightweight JavaScript rendering service with an HTTP API.
