awesome-repositories.com
المدونة
awesome-repositories.com

اكتشف أفضل مستودعات المصادر المفتوحة باستخدام بحث مدعوم بالذكاء الاصطناعي.

استكشفعمليات بحث منسقةبدائل مفتوحة المصدربرمجيات ذاتية الاستضافةالمدونةخريطة الموقع
المشروعحولكيفية ترتيب النتائجالصحافةخادم MCP
قانونيالخصوصيةالشروط
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·
grangier avatar

grangier/python-goose

0
View on GitHub↗
4,088 نجوم·780 تفرعات·HTML·Apache-2.0·2 مشاهدات

Python Goose

python-goose is a Python library for web scraping and content extraction. It functions as an HTML boilerplate remover and article parser designed to isolate primary text and metadata from web pages by stripping away navigation, layout noise, and non-essential elements.

The tool features multilingual processing capabilities, utilizing language-specific stop-word analyzers to identify and extract primary content across different languages. It also identifies and collects embedded media, including source URLs and embed codes for lead images and videos associated with an article.

The library covers broad functional domains including automated web scraping, structured content extraction, and targeted article media collection.

Features

  • Web Article Extraction - Isolates the main body text, title, and meta descriptions from web pages by removing boilerplate clutter.
  • Multilingual Text Processing - Handles content in various languages using specific stop-word analyzers and language tags.
  • Stop-Word Text Scoring - Ranks document segments by comparing word frequency against language-specific lists to find the main content.
  • Content Extractors - Extracts the main article text and metadata from web pages while removing boilerplate.
  • Web Content Noise Reduction - Isolates primary web content by stripping away layout noise and non-essential page elements.
  • Web Article Metadata Extractors - Identifies primary text and metadata across different languages using specialized stop-word analyzers.
  • Web Content Extraction Utilities - Extracts the main text and metadata from web pages while removing navigation and layout clutter.
  • Web Media Extractors - Locates primary images and embedded videos by searching for specific HTML tags and metadata attributes.
  • Automated Web Scraping - Collects structured data and article content from websites using Python to build datasets.
  • Web Media Extractions - Collects source URLs and embed codes for images and videos hosted within web pages.
  • HTML Boilerplate Removal - Identifies and strips navigation and sidebars by analyzing tag density and common class name patterns.
  • Web Scraping Libraries - Provides a programmatic Python interface for collecting data and embedded media from websites.
  • Linguistic Token Analyzers - Uses predefined language tags and analyzers to process and clean text across different multilingual sources.
  • Article Media Asset Extractors - Identifies and captures the primary images and embedded videos associated with specific web articles.
  • Lead Media Detection - The tool locates the primary image and embedded videos associated with an article to capture source URLs and embed codes.
  • DOM Tree Traversers - Implements algorithms to walk through the HTML DOM to isolate the primary article container from layout elements.
  • Structured Data Mappings - Maps standard HTML meta tags to structured data formats for article titles and descriptions.
  • Content Extraction - HTML article content extractor.

سجل النجوم

مخطط تاريخ النجوم لـ grangier/python-gooseمخطط تاريخ النجوم لـ grangier/python-goose

بحث بالذكاء الاصطناعي

استكشف المزيد من المستودعات الرائعة

صف ما تحتاجه بلغة بسيطة — وسيقوم الذكاء الاصطناعي بترتيب آلاف المشاريع مفتوحة المصدر المنسقة حسب الصلة.

Start searching with AI

الأسئلة الشائعة

ما هي وظيفة grangier/python-goose؟

python-goose is a Python library for web scraping and content extraction. It functions as an HTML boilerplate remover and article parser designed to isolate primary text and metadata from web pages by stripping away navigation, layout noise, and non-essential elements.

ما هي الميزات الرئيسية لـ grangier/python-goose؟

الميزات الرئيسية لـ grangier/python-goose هي: Web Article Extraction, Multilingual Text Processing, Stop-Word Text Scoring, Content Extractors, Web Content Noise Reduction, Web Article Metadata Extractors, Web Content Extraction Utilities, Web Media Extractors.

ما هي البدائل مفتوحة المصدر لـ grangier/python-goose؟

تشمل البدائل مفتوحة المصدر لـ grangier/python-goose: generalnewsextractor/generalnewsextractor — GeneralNewsExtractor is a specialized system for identifying and extracting structured news data through configurable… wechatsync/wechatsync — Wechatsync is a multi-platform content synchronizer and cross-platform publishing tool. It extracts articles from… kepano/defuddle — Defuddle is a command line web parser and content extractor designed to isolate the primary article body from web… mozilla/readability — Readability is a JavaScript library designed for web content extraction. It functions as a DOM parsing utility and… esbatmop/mnbvc — MNBVC is a dataset pipeline and toolkit designed for the collection, cleaning, and normalization of massive text and… postlight/parser — Postlight Parser is a command-line tool that extracts the main article content from any web page URL, returning clean…

بدائل مفتوحة المصدر لـ Python Goose

مشاريع مفتوحة المصدر مشابهة، مرتبة حسب عدد الميزات المشتركة مع Python Goose.
  • generalnewsextractor/generalnewsextractorالصورة الرمزية لـ GeneralNewsExtractor

    GeneralNewsExtractor/GeneralNewsExtractor

    3,779عرض على GitHub↗

    GeneralNewsExtractor is a specialized system for identifying and extracting structured news data through configurable HTML filtering and XPath-based parsing. It functions as an automated news scraper and web page content parser that isolates article bodies and metadata from news webpages. The system uses YAML or JSON configuration files to manage extraction rules and XPath definitions, decoupling the processing logic from site-specific selectors. This allows for targeted noise removal and the isolation of titles, authors, and publication dates through customizable filtering. The tool covers

    Pythonpython3webcrawlerwebspider
    عرض على GitHub↗3,779
  • wechatsync/wechatsyncالصورة الرمزية لـ wechatsync

    wechatsync/Wechatsync

    4,866عرض على GitHub↗

    Wechatsync is a multi-platform content synchronizer and cross-platform publishing tool. It extracts articles from webpages and distributes them to multiple social media and blogging platforms simultaneously. The system utilizes a web content extractor with reader-mode logic to strip advertisements and navigation elements from source pages. The project employs a markdown content pipeline that converts extracted web content into a standardized format for editing before redistribution. It features an automated media migrator that performs host-to-host image migration, downloading images from sou

    TypeScriptblogchromechrome-extension
    عرض على GitHub↗4,866
  • kepano/defuddleالصورة الرمزية لـ kepano

    kepano/defuddle

    3,189عرض على GitHub↗

    Defuddle is a command line web parser and content extractor designed to isolate the primary article body from web pages and convert the result into standardized markdown. It functions as a content cleaner that removes layout clutter, such as sidebars and headers, to retrieve the main text and associated metadata. The tool provides a terminal interface that processes content from remote URLs, local files, or piped HTML streams. It supports custom content targeting, allowing users to specify CSS selectors to manually define the main content area when automatic detection is insufficient. The sy

    TypeScript
    عرض على GitHub↗3,189
  • mozilla/readabilityالصورة الرمزية لـ mozilla

    mozilla/readability

    11,298عرض على GitHub↗

    Readability is a JavaScript library designed for web content extraction. It functions as a DOM parsing utility and article metadata extractor that isolates the primary text of a webpage by removing clutter such as advertisements and navigation bars. The library employs a heuristic-based content detector to predict if a webpage contains a parseable article before performing full extraction. It uses a parsing workflow to convert complex HTML documents into a simplified format, facilitating the implementation of distraction-free reader views. The tool covers several capability areas, including

    JavaScript
    عرض على GitHub↗11,298
عرض جميع البدائل الـ 30 لـ Python Goose→