1 dépôt
Awesome GitHub RepositoriesData Pipeline Validation Frameworks
Frameworks designed to verify data integrity at specific stages of a data processing pipeline.
Distinct from Pipeline Validation: None of the candidates capture the specific identity of a validation-first framework for data pipelines.
Explore 1 awesome GitHub repository matching data & databases · Data Pipeline Validation Frameworks. Refine with filters or upvote what's useful.
Awesome Data Pipeline Validation Frameworks GitHub Repositories
Trouvez les meilleurs dépôts grâce à l'IA.Nous recherchons les dépôts les plus pertinents grâce à l'IA.
- unionai-oss/pandera
unionai-oss/pandera
4,382Voir sur GitHubPandera is a data pipeline validation framework and statistical type validation tool. It functions as a library for defining and enforcing schemas on datasets to ensure data quality and consistency, specifically providing validation capabilities for Pandas dataframes. The project includes a schema inference tool that automates setup by analyzing existing dataset samples to generate validation schemas. It also serves as a synthetic data generator, creating artificial datasets based on predefined schemas to verify data-producing functions. The framework covers data engineering quality assuranc
Acts as a comprehensive framework for verifying data integrity at various stages of a processing pipeline.
Pythonassertionsdata-assertionsdata-check
