1 مستودع
Applying code patches to existing tools to modify data cleaning behavior.
Distinct from Patch Application: Specifically targets the extension of data cleaning tools via patches rather than general code patching.
Explore 1 awesome GitHub repository matching software engineering & architecture · Workflow Customization Patches. Refine with filters or upvote what's useful.
MNBVC is a dataset pipeline and toolkit designed for the collection, cleaning, and normalization of massive text and code corpora used to train large language models. It provides specialized tools for harvesting source code, commit histories, and repository metadata from version control platforms, alongside a multilingual text corpus collector for gathering parallel text and academic papers. The project distinguishes itself through comprehensive capabilities for processing diverse document types, including a PDF-to-text converter that transforms complex layouts and formulas into structured JS
Applies pre-processing and post-processing code patches to customize data cleaning workflows in open source software.