ingestr is a command-line tool for copying and syncing data between different database engines and third-party platforms without writing custom code. It functions as an ETL pipeline utility that extracts data from diverse sources and loads it into destinations. The tool features a schema-agnostic data loader that maps source fields to destination columns dynamically, removing the need for predefined static table definitions. It also operates as an incremental data synchronizer, updating destination tables by appending new records or merging changes to maintain current datasets. The system pr
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
Rudder Server is a customer data platform and event routing pipeline designed to collect, transform, and route customer event data from various sources to data warehouses and business tools. It functions as a customer identity resolver, linking identifiers from multiple sources to build a unified identity graph and comprehensive behavioral customer profiles. The system differentiates itself through reverse ETL capabilities, which push processed customer segments and audiences from data warehouses back into operational third-party applications. It also provides a containerized data plane for K
Build platforms that flexibly mix SQL, batch, and stream processing paradigms
The main features of gazette/core are: Data Ingestion, Data Ingestion Pipelines, Data Pipelines.
Open-source alternatives to gazette/core include: bruin-data/bruin — Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end… bruin-data/ingestr — ingestr is a command-line tool for copying and syncing data between different database engines and third-party… netflix/suro — Netflix's distributed Data Pipeline. rudderlabs/rudder-server — Rudder Server is a customer data platform and event routing pipeline designed to collect, transform, and route… apache/pulsar — Apache Pulsar is a cloud-native distributed pub-sub messaging system designed for high-performance data ingestion. It… aklivity/zilla — 🦎 A multi-protocol edge & service proxy. Seamlessly interface web apps, IoT clients, & microservices to Apache Kafka®…
