1 dépôt
Tools designed to parse and extract structured information from large database export files.
Distinct from Memory Dump Parsers: Candidates focus on binary memory dumps for debugging; this is about parsing structured database archives.
Explore 1 awesome GitHub repository matching data & databases · Database Dump Parsers. Refine with filters or upvote what's useful.
Wikiextractor is a Wikipedia dump parser and dataset preprocessor designed to extract plain text and metadata from MediaWiki database dumps. It functions as a converter that transforms these archives into structured document files or line-delimited JSON objects for use in text corpora and machine learning datasets. The utility includes a MediaWiki template expander that resolves complex template placeholders into their full text representation. It also supports the isolation and extraction of specific individual pages from a full archive without requiring the processing of the entire dataset.
Extracts plain text and metadata from MediaWiki database dumps into structured document files.