jhy/jsoup
Jsoup
Jsoup is a Java library designed for parsing, extracting, and manipulating HTML and XML content. It provides a document object model that represents web content as a hierarchical tree, allowing for programmatic navigation and modification of elements, attributes, and text. The library functions as a toolkit for web scraping, enabling the retrieval of remote content via standard web protocols and the management of HTTP sessions for automated form interaction.
The library distinguishes itself through its fault-tolerant tokenization, which reconstructs valid document structures from malformed or non-standard markup. It utilizes CSS-style selector syntax for querying and traversing document trees, providing a flexible way to locate specific nodes. Additionally, it includes a security utility that filters untrusted HTML against a configurable safelist to prevent cross-site scripting vulnerabilities while preserving safe content.
The project supports a broad range of document processing capabilities, including incremental stream parsing for memory-efficient handling of large files and serialization mechanisms for outputting formatted HTML or text. It offers extensive configuration options for parsing sensitivity, ensuring compatibility with specific standards and document requirements. The library is designed to integrate with external tools by converting parsed structures into W3C-compliant document formats.
Features
- HTML Document Transformation - Converts raw HTML strings and streams into a structured document object model.
- HTML Parsers - Provides a comprehensive library for parsing, extracting, and manipulating HTML content using DOM traversal and CSS selectors.
- HTML Allowlists - Cleans untrusted HTML content against a strict allow-list to prevent security vulnerabilities.
- In-Memory DOM Representations - Models web content as a hierarchical tree of nodes to enable programmatic navigation and manipulation.
- Web Scraping - Provides robust utilities for extracting structured data from websites and online sources.
- HTML Content Filters - Filters untrusted HTML against a configurable safelist to prevent cross-site scripting while preserving safe content.
- HTML Content Processing - Parses and integrates raw HTML strings into structured document models for programmatic access.
- Hierarchical Document Models - Represents web content as a hierarchical tree of elements, text, and comments for programmatic access.
- Remote Content Fetchers - Retrieves and processes remote web content via standard protocols for scraping and data extraction tasks.
- Web Scraping - Offers a toolkit for fetching remote web content, managing HTTP sessions, and cleaning untrusted HTML input.
- Document Object Models - Models web content as a hierarchical tree of nodes to enable programmatic navigation and structural modification.
- Android Development Utilities - Java library for parsing and manipulating HTML.
- General Utilities - Parses, manipulates, and cleans HTML content.
- CSS Selector Engines - Locates specific nodes within a document structure using CSS-style selector syntax.
- CSS Selectors - Uses CSS-style selector syntax to efficiently locate and traverse specific nodes within a document tree.
- Form Submission Clients - Automates web form interaction by extracting fields and managing session state for data entry.
- XML Parsers - Processes XML input using specific rules to ensure accurate structure for non-HTML data formats.
- Tree Traversal Engines - Enables recursive navigation and inspection of hierarchical document structures.
- Fault-Tolerant Architectures - Implements fault-tolerant tokenization to reconstruct valid document structures from malformed or non-standard markup.
- Form Processing - Extracts form fields and controls to simplify automated data retrieval and submission.
- Document Parsing Engines - Processes input incrementally to build document structures efficiently without loading entire files into memory.
- Incremental Data Streaming - Supports incremental stream parsing to handle large files with a reduced memory footprint.
- Element Attributes - Provides methods to inspect, modify, and extract attributes from HTML elements.
