5 Repos
Techniques for ensuring data converges without a central coordinator using associative and commutative merge functions.
Distinct from Data Replication: Distinct from Data Replication: focuses specifically on the mathematical properties of merge functions for convergence.
Explore 5 awesome GitHub repositories matching data & databases · Replicated Data Convergence. Refine with filters or upvote what's useful.
This project provides educational materials and courseware focused on the theoretical and practical foundations of distributed systems design. It serves as a comprehensive curriculum covering the disciplines of consensus, data consistency, reliability engineering, and scalability. The instructional content focuses on achieving cluster agreement through consensus algorithms and managing system-wide state via coordination frameworks. It includes a dedicated guide to data theory, exploring replication strategies, consistency models, and data convergence. The courseware covers a broad capability
Explains how to achieve data convergence using associative and commutative merge functions without central coordination.
Otter is a distributed database synchronization system and change data capture tool designed to replicate data between databases across multiple geographic regions. It functions as a synchronization orchestrator and ETL data pipeline that mirrors records and associated files in real time. The system employs incremental log parsing to capture database changes and utilizes a consistency-based convergence algorithm and loop-avoidance logic to manage bi-directional replication. It processes data through a pipeline of selection, extraction, transformation, and loading to handle joins and format co
Implements a consistency-based convergence algorithm to ensure final data agreement across disparate data centers.
Automerge ist eine Engine zur verteilten Zustandssynchronisation und eine Bibliothek für konfliktfreie replizierte Datentypen (CRDTs). Sie ermöglicht es mehreren Knoten, gleichzeitige Updates an einem gemeinsamen Datensatz vorzunehmen, während garantiert wird, dass alle Replikate schließlich in denselben Zustand konvergieren. Das Projekt bietet eine in Rust geschriebene Hochleistungs-Implementierung zur Verwaltung von Zustandszusammenführungen und Synchronisation. Es verwendet ein byte-komprimiertes Synchronisationsprotokoll, um minimale Delta-Updates zwischen Peers zu übertragen, was die Datenkonsistenz in Peer-to-Peer- und Echtzeit-Kollaborationsumgebungen erleichtert. Das System deckt breite Funktionen für verteilten geteilten Zustand ab, einschließlich kausaler Graph-Konfliktauflösung, Operation-Log-Replay und sprachunabhängiger Datencodierung. Es enthält Verifizierungsprozesse, um sicherzustellen, dass Dokumente und Datenwerte über verschiedene Betriebssysteme und Sprachimplementierungen hinweg konsistent interpretiert werden.
Uses mathematically defined conflict-free replicated data types to ensure all replicas eventually converge to the same state.
Algodeck is an open-source collection of flash cards designed for reviewing algorithms, data structures, and system design concepts, specifically curated for technical interview preparation. The project organizes knowledge into atomic question-and-answer pairs and incorporates spaced repetition scheduling to optimize long-term memory retention. The flash card catalog covers a broad range of computer science topics, including classic sorting algorithms like quicksort and mergesort, data structure operations for arrays, trees, heaps, tries, and graphs, as well as bit manipulation techniques for
Explains CRDT-based convergence for conflict-free replicated data types.
cr-sqlite is a multi-master database replication system that uses conflict-free replicated data types to ensure eventual consistency across distributed nodes. It provides the core capabilities for offline-first data synchronization, allowing multiple database instances to merge concurrent updates and reach a consistent state. The project distinguishes itself through a combination of CRDT-based data replication and a WASM-based database engine, enabling full SQL execution and state persistence within web browsers. It supports peer-to-peer replication and cross-tab synchronization, utilizing ca
Ensures all replicas eventually reach the same state regardless of the order in which updates are received.