1 个仓库
Awesome GitHub RepositoriesData Pipeline Validation Frameworks
Frameworks designed to verify data integrity at specific stages of a data processing pipeline.
Distinct from Pipeline Validation: None of the candidates capture the specific identity of a validation-first framework for data pipelines.
Explore 1 awesome GitHub repository matching data & databases · Data Pipeline Validation Frameworks. Refine with filters or upvote what's useful.
Awesome Data Pipeline Validation Frameworks GitHub Repositories
用 AI 发现最棒的仓库。我们将通过 AI 为您搜索最匹配的仓库。
- unionai-oss/pandera
unionai-oss/pandera
4,382在 GitHub 上查看Pandera is a data pipeline validation framework and statistical type validation tool. It functions as a library for defining and enforcing schemas on datasets to ensure data quality and consistency, specifically providing validation capabilities for Pandas dataframes. The project includes a schema inference tool that automates setup by analyzing existing dataset samples to generate validation schemas. It also serves as a synthetic data generator, creating artificial datasets based on predefined schemas to verify data-producing functions. The framework covers data engineering quality assuranc
Acts as a comprehensive framework for verifying data integrity at various stages of a processing pipeline.
Pythonassertionsdata-assertionsdata-check
