F
FriendsOfPHP/Goutte
Goutte
Goutte is a PHP web scraper and DOM crawler designed for extracting data from websites. It functions as an HTTP client wrapper that enables the retrieval of web pages and the parsing of HTML content.
The project provides a web form automator to programmatically fill and submit HTML forms to remote servers. It also includes a mechanism for automated website crawling by following links to discover and archive web content.
The system supports stateful session management to maintain cookies and headers across requests. It further covers HTML data extraction through DOM-based element selection and CSS selectors.
Features
- Web Content Scrapers - A tool for extracting data from websites by requesting pages and parsing HTML content using PHP.
- Data Extractions - Parses HTML strings into a document object model to allow precise data extraction via CSS selectors.
- Web Crawling - Navigating through a site structure automatically by following links to discover and archive web content.
- Website Crawlers - Traverses a website by extracting anchor tags and triggering new HTTP requests to the discovered URLs.
- HTTP Client Wrappers - A simplified interface for making web requests and managing sessions based on the Guzzle and Symfony components.
- HTTP Clients - Uses a synchronous HTTP client to fetch remote web pages and manage network requests and responses.
- DOM Crawlers - A mechanism for navigating HTML document structures and selecting specific elements using CSS selectors.
- DOM Attribute Retrieval - A utility for retrieving specific text or attributes from web responses by filtering DOM elements using selectors.
- Form Submission Clients - A capability within the product to programmatically fill out page elements and send the completed data to a remote server.
- Automated Form Fillers - Filling out and submitting online forms programmatically using PHP to interact with remote web servers.
- HTML DOM Manipulators - Parsing and filtering HTML elements from web responses to retrieve targeted attributes and content.
- Web Scraping - Extracting specific text and data from websites using PHP to automate information gathering.
- Website Crawlers and Scrapers - A functionality allowing the product to navigate site structures automatically by requesting web pages and following embedded links.
- HTTP Session Simulations - Maintains persistent cookies and headers across multiple requests to simulate a real browser user session.
- Form Field Mappers - Maps key-value pairs to HTML input elements to automate the submission of web forms to remote servers.
- PHP Crawling Frameworks - Library for screen scraping and web crawling.
