1 रिपॉजिटरी
Awesome GitHub RepositoriesMarkup Stripping
Processes that use patterns to remove formatting tags and metadata to extract clean plain text.
Distinct from Regex-Based Data Imports: Candidates focus on colorizers or data imports, not the removal of markup for text cleaning.
Explore 1 awesome GitHub repository matching data & databases · Markup Stripping. Refine with filters or upvote what's useful.
Awesome Markup Stripping GitHub Repositories
AI के साथ बेहतरीन रिपॉजिटरी खोजें।हम AI का उपयोग करके सबसे सटीक रिपॉजिटरी खोजेंगे।
- attardi/wikiextractor
attardi/wikiextractor
3,970GitHub पर देखेंWikiextractor is a Wikipedia dump parser and dataset preprocessor designed to extract plain text and metadata from MediaWiki database dumps. It functions as a converter that transforms these archives into structured document files or line-delimited JSON objects for use in text corpora and machine learning datasets. The utility includes a MediaWiki template expander that resolves complex template placeholders into their full text representation. It also supports the isolation and extraction of specific individual pages from a full archive without requiring the processing of the entire dataset.
Uses regular expression patterns to strip wiki-specific formatting and metadata to produce clean plain text.
Python
