4 Repos
Maintenance of materialized view accuracy by processing append, update, and delete operations from changelog streams.
Distinct from Database Change Streaming: Distinct from Database Change Streaming: focuses on how the changes are applied to internal state (semantics) rather than the transmission of the stream.
Explore 4 awesome GitHub repositories matching networking & communication · Change Stream Semantics. Refine with filters or upvote what's useful.
RisingWave is a cloud-native streaming database and real-time analytics engine that uses standard SQL to process continuous data streams. It functions as a streaming data lakehouse, combining the capabilities of a streaming SQL database with a platform that integrates streaming ingestion with open table formats. The system is distinguished by its use of the PostgreSQL wire protocol, allowing it to integrate with existing SQL tools and drivers. It employs a decoupled compute and storage architecture, persisting streaming state and materialized views in cloud object storage to enable independen
Processes changelog streams using append, update, and delete operations to keep materialized views accurate in real time.
Delta is a lakehouse table format that brings ACID transactions and data warehouse consistency to large scale data lakes on cloud object storage. It serves as an ACID transaction manager, coordinating atomic commits and serializable isolation for concurrent reads and writes across distributed compute engines. The project provides a multi-engine interoperability layer that uses format translation to allow diverse SQL engines and processing frameworks to read and write the same tables. It functions as a data versioning system, utilizing a transaction log to enable time travel, historical snapsh
Consumes tables as streaming sources to process changes starting from specific versions or timestamps.
Apache Hudi is an open-source table format that brings ACID transactions, incremental processing, and multi-modal indexing to data lakes. It provides atomic commits with snapshot isolation, rollback, and optimistic concurrency control for reliable data lake operations, while supporting upserts, record-level updates, and deletions in large analytical datasets. The project distinguishes itself through a timeline-based architecture that coordinates all write operations, enabling features like time-travel querying, incremental change streaming, and multi-modal query views that include snapshot, i
Delivers a feed of records inserted or updated after a given point in time for downstream processing.
Sqlbrite ist ein reaktiver SQLite-Datenbankmanager und ein leichtgewichtiger Wrapper für Android. Er fungiert als reaktive SQL-Bibliothek, die standardmäßige SQLite-Abfragen in beobachtbare Streams umwandelt, sodass die Anwendung automatisch neue Ergebnisse ausgibt, wenn sich zugrunde liegende Datenbanktabellen ändern. Das Projekt bietet einen Mechanismus zur Verfolgung von Änderungen an spezifischen Datenbanktabellen, wodurch Abfrage-Aktualisierungen ohne manuelles Polling ausgelöst werden. Es enthält zudem einen atomaren Transaktionsmanager, um mehrere SQL-Modifikationen in Einheiten zu gruppieren, was die Datenintegrität sicherstellt und redundante Benachrichtigungen verhindert. Die Bibliothek verwaltet die lokale Datenpersistenz unter Android, indem sie Schema-Operationen und das Datenbank-Lifecycle-Management an den Standard-SQLite-Helper delegiert. Die Kernfunktionen umfassen die Echtzeit-Datenbeobachtung und die Verwaltung von Datenbanktransaktionen.
Links SQL queries to the tables they reference to automate the refreshing of active data streams.