1 Repo
Awesome GitHub RepositoriesDirty Data Captures
Mechanisms to isolate records that fail validation or type conversion during data pipelines.
Distinct from Data Quality and Validation: The candidates for dirty checking or data quality do not cover the specific architectural pattern of isolating failing records to prevent pipeline crashes.
Explore 1 awesome GitHub repository matching data & databases · Dirty Data Captures. Refine with filters or upvote what's useful.
Awesome Dirty Data Captures GitHub Repositories
Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
- alibaba/datax
alibaba/DataX
17,241Auf GitHub ansehenDataX is a distributed data integration framework and plugin-based ETL tool designed for synchronizing large datasets between heterogeneous sources and destinations. It functions as a JDBC data migration engine and offline synchronization tool, enabling the movement of data between relational databases, NoSQL stores, and object storage. The system utilizes a plugin-based connector architecture that decouples reader and writer logic, allowing it to map and transform data types across different storage engines using a standardized internal representation. This design supports heterogeneous data
Provides a dirty-data capture mechanism to intercept and isolate records failing type conversion, ensuring pipeline stability.
Java
