3 Repos
Mechanisms for tracking and persisting the state of data processing tasks to ensure recovery.
Distinguishing note: Focuses on stateful log position tracking for reliable delivery.
Explore 3 awesome GitHub repositories matching data & databases · Data Synchronization Checkpoints. Refine with filters or upvote what's useful.
Canal is a database replication middleware that performs change data capture by simulating a database replica. It monitors transaction logs to stream incremental data modifications to downstream systems in real time, acting as an event streaming infrastructure that transforms low-level binary logs into structured, consumable message streams. The project distinguishes itself through a high-throughput architecture that utilizes concurrent multi-threaded parsing and stateful log position tracking to ensure reliable data delivery. It employs a pluggable sink architecture that decouples data extra
Maintains persistent markers of the last processed transaction to ensure reliable data delivery and recovery.
This project is a reactive, offline-first NoSQL database engine designed for JavaScript applications. It provides a robust framework for managing application state by synchronizing data across browsers, mobile devices, and server-side runtimes. By treating local storage as the primary source of truth, it enables applications to remain functional without network connectivity, automatically reconciling changes with remote backends once a connection is restored. The database distinguishes itself through a modular architecture that supports cross-environment synchronization and high-performance d
Fetches document updates from a server using checkpoints to ensure incremental data retrieval and efficient batch processing.
This project provides the formal technical specifications and reference logic for the Ethereum proof-of-stake consensus layer. It defines the standards for block production, state transition rules, and the beacon chain logic required to ensure consistent network agreement. The implementation covers specialized mechanisms for chain security and efficiency, including fork-choice algorithms for canonical chain determination, committee-based signature aggregation, and KZG-based blob commitments for data availability. It also specifies the protocols for light client synchronization using sync comm
Implements synchronization using anchor checkpoints to establish a trusted state without full execution verification.