How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
Mimesis is a Python synthetic data generator used to create realistic fake datasets and mock data for software testing and development. It functions as a schema-based dataset generator capable of producing structured records and relational datasets, while also serving as a production data anonymizer to replace sensitive information with synthetic values. The library distinguishes itself through comprehensive multilingual support, allowing for the generation of locale-specific information to simulate regional user profiles. It ensures reproducibility through deterministic data generation using
Replibyte is a tool that automates the lifecycle of database snapshots for non-production environments, handling the export, anonymization, subsetting, and restoration of data. It is designed to support privacy-compliant development workflows by replacing sensitive production data with synthetic values and extracting consistent subsets of rows while preserving referential integrity. The tool operates through a configurable pipeline defined in a YAML file, orchestrating stages such as dump, anonymize, subset, and restore. Each operation runs as an isolated, ephemeral container job, and snapsho
Presidio is a PII detection and anonymization framework designed to identify and mask personally identifiable information in text. It functions as a PII recognition pipeline and a data masking engine, using a combination of machine learning, regular expressions, and rule-based logic to locate sensitive entities. The system acts as an NER model orchestrator, allowing for the integration of external named entity recognition models and PII detectors to support multi-language privacy scrubbing. It employs a plugin-based recognizer architecture that can be extended with custom recognizers, deny-li
This project is a Python workflow orchestration platform and programmatic data pipeline engine used to author, schedule, and monitor complex data pipelines. It functions as a directed acyclic graph manager and scheduler, allowing users to define data movement and transformation tasks as code to ensure precise execution order and maintainability. The platform distinguishes itself by treating workflows as code, enabling pipelines to be versioned and tested through a standard programming language. It utilizes a system of extensible operators to encapsulate integration logic and employs a templat
NeoSync is a database synchronization tool and data pipeline orchestrator designed to move and transform datasets across different environments. It functions as a PII data security platform and a synthetic data generator, allowing for the synchronization of production data while ensuring privacy compliance.
The main features of nucleuscloud/neosync are: Database Environment Synchronization, Synthetic Data Generators, Relational Database Subsetting, Data Pipeline Orchestration, Database Synchronization Tools, Production Data Subsetting, Data Anonymization, PII Detection and Screening.
Projects with overlapping indexed features include: lk-geimfari/mimesis — Mimesis is a Python synthetic data generator used to create realistic fake datasets and mock data for software testing… qovery/replibyte — Replibyte is a tool that automates the lifecycle of database snapshots for non-production environments, handling the… microsoft/presidio — Presidio is a PII detection and anonymization framework designed to identify and mask personally identifiable… dbt-labs/dbt-core — dbt-core is a command-line framework for transforming data within a warehouse using modular SQL and version control.… dagster-io/dagster — Dagster is a data orchestration platform designed to manage the entire lifecycle of data assets through declarative… apache/incubator-airflow — This project is a Python workflow orchestration platform and programmatic data pipeline engine used to author,…