1 Repo
Awesome GitHub RepositoriesData Pipeline Validation Frameworks
Frameworks designed to verify data integrity at specific stages of a data processing pipeline.
Distinct from Pipeline Validation: None of the candidates capture the specific identity of a validation-first framework for data pipelines.
Explore 1 awesome GitHub repository matching data & databases · Data Pipeline Validation Frameworks. Refine with filters or upvote what's useful.
Awesome Data Pipeline Validation Frameworks GitHub Repositories
Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
- unionai-oss/pandera
unionai-oss/pandera
4,382Auf GitHub ansehenPandera is a data pipeline validation framework and statistical type validation tool. It functions as a library for defining and enforcing schemas on datasets to ensure data quality and consistency, specifically providing validation capabilities for Pandas dataframes. The project includes a schema inference tool that automates setup by analyzing existing dataset samples to generate validation schemas. It also serves as a synthetic data generator, creating artificial datasets based on predefined schemas to verify data-producing functions. The framework covers data engineering quality assuranc
Acts as a comprehensive framework for verifying data integrity at various stages of a processing pipeline.
Pythonassertionsdata-assertionsdata-check
