1 repositorio
Awesome GitHub RepositoriesDirty Data Captures
Mechanisms to isolate records that fail validation or type conversion during data pipelines.
Distinct from Data Quality and Validation: The candidates for dirty checking or data quality do not cover the specific architectural pattern of isolating failing records to prevent pipeline crashes.
Explore 1 awesome GitHub repository matching data & databases · Dirty Data Captures. Refine with filters or upvote what's useful.
Awesome Dirty Data Captures GitHub Repositories
Encuentra los mejores repositorios con IA.Buscaremos los repositorios que mejor coincidan usando IA.
- alibaba/datax
alibaba/DataX
17,241Ver en GitHubDataX is a distributed data integration framework and plugin-based ETL tool designed for synchronizing large datasets between heterogeneous sources and destinations. It functions as a JDBC data migration engine and offline synchronization tool, enabling the movement of data between relational databases, NoSQL stores, and object storage. The system utilizes a plugin-based connector architecture that decouples reader and writer logic, allowing it to map and transform data types across different storage engines using a standardized internal representation. This design supports heterogeneous data
Provides a dirty-data capture mechanism to intercept and isolate records failing type conversion, ensuring pipeline stability.
Java
