1 repo
Systems designed to ingest massive volumes of data with minimal latency.
Distinguishing note: Focuses on ingestion performance, distinct from general data processing frameworks.
Explore 1 awesome GitHub repository matching data & databases · High-Throughput Ingestion Pipelines. Refine with filters or upvote what's useful.
TDengine is a distributed time-series database designed for the high-speed ingestion, compression, and retrieval of timestamped metrics and sensor data. It functions as a SQL-compatible analytics engine, allowing users to perform complex operations on massive volumes of time-ordered information using standard relational syntax. The platform is built to serve as a backend foundation for industrial IoT environments, managing real-time data streams and device metadata through a cluster-based architecture. The system distinguishes itself through a distributed sharding architecture that uses consi
Streams large volumes of information using automated batching and sharding to maximize throughput.