awesome-repositories.com
Blog
MCP
awesome-repositories.com

Discover the best open-source repositories with AI-powered search.

ExploreCurated searchesOpen-source alternativesSelf-hosted softwareBlogSitemap
ProjectMCP serverAboutHow we rankPress
LegalPrivacyTerms
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
mozilla avatar

mozilla/readability

0
View on GitHub↗

Readability

Readability is a JavaScript library designed for web content extraction. It functions as a DOM parsing utility and article metadata extractor that isolates the primary text of a webpage by removing clutter such as advertisements and navigation bars.

The library employs a heuristic-based content detector to predict if a webpage contains a parseable article before performing full extraction. It uses a parsing workflow to convert complex HTML documents into a simplified format, facilitating the implementation of distraction-free reader views.

The tool covers several capability areas, including the identification of readable content, the extraction of the main article body, and the isolation of canonical titles and author information. It utilizes structural analysis and text filtering to distinguish primary content from sidebars and other non-essential elements.

AI search

Explore more awesome repositories

Describe what you need in plain English — the AI ranks thousands of curated open-source projects by relevance.

Start searching with AI

Features

  • Body Content Extractors - Parses HTML to isolate the primary body text while stripping markup and navigation elements.
  • Full-Text Content Extraction - Processes web pages to retrieve a cleaned, full-text version of the article content.
  • Extractability Detection - Evaluate a document using lightweight heuristics to determine if it contains an article suitable for extraction before starting full processing.
  • Heuristic Extraction Methods - Analyzes HTML tag frequency, text density, and structural patterns to locate main content.
  • Web Article Extraction - Isolates the main body text and core content from web pages and news articles.
  • Metadata Extraction - Extracts descriptive page metadata, including Open Graph tags and canonical titles, from the document head.
  • Clutter Removal - Strips non-essential elements like ads and navigation bars using predefined clutter patterns to isolate primary content.
  • Reader Views - Creates simplified page presentations that strip away non-essential elements for focused reading.
  • Content-Aware DOM Parsers - Analyzes document structure and heuristics to identify and extract readable content from webpages.
  • DOM Density Analysis - Analyzes the DOM tree to identify parent containers with high densities of text and paragraph tags.
  • Element Scoring Heuristics - Assigns numerical values to HTML elements based on class names and IDs to identify primary content areas.
  • Pre-Extraction Heuristics - Evaluates document length and structure using simple triggers to avoid processing non-article pages.
  • Web Article Metadata Extractors - Identifies and returns the title and metadata of a webpage for simplified reading views.
  • Extractability Tests - Analyzes HTML structure to determine if a page contains a main body of text suitable for extraction.
  • Text-to-Markup Ratios - Implements density-based filtering to distinguish article bodies from sidebars by analyzing text-to-markup ratios.
  • Extraction Feasibility Analysis - Analyzes the structure of a document to determine if it contains extractable content before performing a full parse.
  • Parsing Tools - Content extraction library.
11,298 stars·722 forks·JavaScript·58 views

Star history

Star history chart for mozilla/readabilityStar history chart for mozilla/readability

How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.

Frequently asked questions

What does mozilla/readability do?

Readability is a JavaScript library designed for web content extraction. It functions as a DOM parsing utility and article metadata extractor that isolates the primary text of a webpage by removing clutter such as advertisements and navigation bars.

What are the main features of mozilla/readability?

The main features of mozilla/readability are: Body Content Extractors, Full-Text Content Extraction, Extractability Detection, Heuristic Extraction Methods, Web Article Extraction, Metadata Extraction, Clutter Removal, Reader Views.

Which projects share features with mozilla/readability?

Projects with overlapping indexed features include: kepano/defuddle — Defuddle is a command line web parser and content extractor designed to isolate the primary article body from web… adbar/trafilatura — Trafilatura is a Python library and command-line tool for extracting clean, structured text and metadata from web… generalnewsextractor/generalnewsextractor — GeneralNewsExtractor is a specialized system for identifying and extracting structured news data through configurable… postlight/parser — Postlight Parser is a command-line tool that extracts the main article content from any web page URL, returning clean… readyouapp/readyou — ReadYou is a self-hosted reading application and RSS feed aggregator that centralizes content from multiple web… grangier/python-goose — python-goose is a Python library for web scraping and content extraction. It functions as an HTML boilerplate remover…

Projects sharing features with Readability

These projects share indexed features with Readability. Shared tags can include platform or build tooling; verify the primary use case before treating a result as a replacement.
  • kepano/defuddlekepano avatar

    kepano/defuddle

    3,189View on GitHub↗

    Defuddle is a command line web parser and content extractor designed to isolate the primary article body from web pages and convert the result into standardized markdown. It functions as a content cleaner that removes layout clutter, such as sidebars and headers, to retrieve the main text and associated metadata. The tool provides a terminal interface that processes content from remote URLs, local files, or piped HTML streams. It supports custom content targeting, allowing users to specify CSS selectors to manually define the main content area when automatic detection is insufficient. The sy

    TypeScript
    View on GitHub↗3,189
  • adbar/trafilaturaadbar avatar

    adbar/trafilatura

    5,319View on GitHub↗

    Trafilatura is a Python library and command-line tool for extracting clean, structured text and metadata from web pages. It downloads HTML content, identifies the main body of text, and strips away navigation, ads, and other boilerplate, returning the core article content along with fields like title, author, date, and URL. The tool can also extract user comments and test whether a page contains extractable text, making it a general-purpose web text extraction library. What distinguishes Trafilatura from simpler extractors is its configurable extraction pipeline, which offers high-speed, high

    Pythonarticle-extractorcorpus-buildercorpus-tools
    View on GitHub↗5,319
  • generalnewsextractor/generalnewsextractorGeneralNewsExtractor avatar

    GeneralNewsExtractor/GeneralNewsExtractor

    3,779View on GitHub↗

    GeneralNewsExtractor is a specialized system for identifying and extracting structured news data through configurable HTML filtering and XPath-based parsing. It functions as an automated news scraper and web page content parser that isolates article bodies and metadata from news webpages. The system uses YAML or JSON configuration files to manage extraction rules and XPath definitions, decoupling the processing logic from site-specific selectors. This allows for targeted noise removal and the isolation of titles, authors, and publication dates through customizable filtering. The tool covers

    Pythonpython3webcrawlerwebspider
    View on GitHub↗3,779
  • postlight/parserpostlight avatar

    postlight/parser

    5,786View on GitHub↗

    Postlight Parser is a command-line tool that extracts the main article content from any web page URL, returning clean structured data including the title, author, date, excerpt, and lead image while stripping away ads and clutter. It uses a readability-based heuristic that scores HTML elements on text density and structural cues to identify the article body, and can accept pre-fetched HTML strings directly for parsing instead of fetching the URL. The tool distinguishes itself through a modular architecture that supports domain-specific extractor overrides, allowing custom JavaScript modules t

    JavaScriptjestlabsmercury
    View on GitHub↗5,786
Compare all 30 related projects→