symfony/dom-crawler
Dom Crawler
Este es un analizador de DOM HTML y XML diseñado para cargar y navegar por la estructura de documentos web para extraer puntos de datos específicos. Funciona como una utilidad de web scraping que proporciona un sistema para localizar elementos precisos utilizando un motor de selectores CSS y XPath.
La biblioteca incluye un resolvedor de URI que convierte enlaces relativos encontrados en documentos en direcciones absolutas utilizando una URI base. Proporciona un conjunto de herramientas para recuperar texto, atributos y fuentes de medios del contenido analizado.
El conjunto de herramientas cubre el recorrido de la jerarquía del documento, el filtrado basado en selectores y la extracción de texto con normalización de espacios en blanco. Admite el procesamiento programático de estructuras XML y la verificación de la presencia de elementos en páginas web.
Features
- HTML and XML Parsing - Provides a complete system for loading and processing HTML and XML markup documents.
- XML and HTML Document Parsers - Provides a DOM parser to load HTML and XML documents into traversable in-memory trees for data extraction.
- XML Processing - Provides capabilities for parsing, navigating, and filtering XML structures to retrieve nested information.
- Markup Content Extractors - Retrieves inner or outer element content with whitespace normalization for clean text output.
- CSS and XPath Query Engines - Provides a combined engine to locate elements using both CSS selectors and XPath 1.0 expressions.
- Absolute Link Resolvers - Implements logic to convert relative links found in markup documents into absolute URLs using a base URI.
- Web Scraping Utilities - Offers a suite of tools for extracting text, attributes, and media sources from parsed web content.
- Hybrid CSS-XPath Selectors - Combines CSS selectors and XPath queries to target and filter precise elements within a document.
- In-Memory DOM Representations - Implements an in-memory DOM tree representation that allows for ergonomic navigation and manipulation of HTML and XML.
- Web Scraping and Extraction - Functions as a web scraping utility to extract structured data from websites using CSS and XPath.
- Relative Link Resolvers - Calculates absolute addresses by merging relative link attributes with a provided base URI.
- DOM Structure Navigators - Traverses the structure of HTML or XML files to find and extract specific elements.
- DOM Hierarchy Traversers - Allows recursive navigation of the document tree to locate ancestors and nested child nodes.
- URI Normalization - Converts relative or fragment links into canonical absolute addresses using a base URI.
- DOM Tree Traversers - Navigates the document tree to find ancestors, closest matching elements, or specific child nodes.
- Web Testing Frameworks - Enables programmatic verification of element presence and structure for automated web testing.
- PHP Crawling Frameworks - Component for DOM navigation in HTML/XML.
