Iggy is a distributed message streaming platform and multi-protocol message broker that functions as a persistent distributed log store. It provides infrastructure for publishing and consuming binary messages using an append-only log, ensuring high availability and data consistency across nodes through Viewstamped Replication. The platform is distinguished by its specialized LLM streaming infrastructure, which uses a server protocol to connect large language models to streaming data and system controls. This includes standardized protocols for context management and data bridging via HTTP or
🦎 A multi-protocol edge & service proxy. Seamlessly interface web apps, IoT clients, & microservices to Apache Kafka® via declaratively defined, stateless APIs.
A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.
Data ingestion engine — Singer taps to Parquet in cloud buckets
The main features of dataspoclab/dataspoc-pipe are: Data Ingestion Pipelines.
Open-source alternatives to dataspoclab/dataspoc-pipe include: apache/iggy — Iggy is a distributed message streaming platform and multi-protocol message broker that functions as a persistent… awslabs/aws-data-wrangler — This project is an AWS pandas integration library and data pipeline framework designed to simplify the movement and… apache/incubator-gobblin — A distributed data integration framework that simplifies common aspects of big data integration such as data… apache/pulsar — Apache Pulsar is a cloud-native distributed pub-sub messaging system designed for high-performance data ingestion. It… aklivity/zilla — 🦎 A multi-protocol edge & service proxy. Seamlessly interface web apps, IoT clients, & microservices to Apache Kafka®… airbnb/kafkat — KafkaT-ool.
