A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.
linkedin/gobblin 的主要功能包括：Big Data Frameworks, Data Ingestion, Data Ingestion and Integration, Data Ingestion Pipelines。
linkedin/gobblin 的开源替代品包括： netflix/suro — Netflix's distributed Data Pipeline. bruin-data/ingestr — ingestr is a command-line tool for copying and syncing data between different database engines and third-party… aklivity/zilla — 🦎 A multi-protocol edge & service proxy. Seamlessly interface web apps, IoT clients, & microservices to Apache Kafka®… apache/pulsar — Apache Pulsar is a cloud-native distributed pub-sub messaging system designed for high-performance data ingestion. It… bruin-data/bruin — Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end… facebookarchive/scribe — Scribe is a distributed log aggregation system designed to collect and route real-time log data from numerous servers…
Apache Pulsar is a cloud-native distributed pub-sub messaging system designed for high-performance data ingestion. It functions as a geo-replicated data streamer and a multi-tenant event streaming platform, providing a serverless stream processing engine and a tiered storage messaging broker. The system distinguishes itself by separating serving layers from storage layers to allow independent scaling of compute and data retention. It features native geo-replication to synchronize messages across different geographical regions and employs a multi-layered tenant isolation model using authentica
🦎 A multi-protocol edge & service proxy. Seamlessly interface web apps, IoT clients, & microservices to Apache Kafka® via declaratively defined, stateless APIs.
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
