5 repositorios
Techniques for ensuring data converges without a central coordinator using associative and commutative merge functions.
Distinct from Data Replication: Distinct from Data Replication: focuses specifically on the mathematical properties of merge functions for convergence.
Explore 5 awesome GitHub repositories matching data & databases · Replicated Data Convergence. Refine with filters or upvote what's useful.
This project provides educational materials and courseware focused on the theoretical and practical foundations of distributed systems design. It serves as a comprehensive curriculum covering the disciplines of consensus, data consistency, reliability engineering, and scalability. The instructional content focuses on achieving cluster agreement through consensus algorithms and managing system-wide state via coordination frameworks. It includes a dedicated guide to data theory, exploring replication strategies, consistency models, and data convergence. The courseware covers a broad capability
Explains how to achieve data convergence using associative and commutative merge functions without central coordination.
Otter is a distributed database synchronization system and change data capture tool designed to replicate data between databases across multiple geographic regions. It functions as a synchronization orchestrator and ETL data pipeline that mirrors records and associated files in real time. The system employs incremental log parsing to capture database changes and utilizes a consistency-based convergence algorithm and loop-avoidance logic to manage bi-directional replication. It processes data through a pipeline of selection, extraction, transformation, and loading to handle joins and format co
Implements a consistency-based convergence algorithm to ensure final data agreement across disparate data centers.
Automerge es un motor de sincronización de estado distribuido y una librería para tipos de datos replicados libres de conflictos (CRDT). Permite que múltiples nodos realicen actualizaciones concurrentes en un conjunto de datos compartido, garantizando que todas las réplicas converjan eventualmente al mismo estado. El proyecto proporciona una implementación de alto rendimiento escrita en Rust para gestionar la fusión y sincronización de estados. Emplea un protocolo de sincronización comprimido en bytes para transmitir actualizaciones delta mínimas entre pares, facilitando la consistencia de datos en entornos peer-to-peer y de colaboración en tiempo real. El sistema cubre amplias capacidades para el estado compartido distribuido, incluyendo resolución de conflictos mediante grafos causales, reproducción de registros de operaciones y codificación de datos agnóstica al lenguaje. Incluye procesos de verificación para asegurar que los documentos y valores de datos se interpreten de manera consistente a través de diferentes sistemas operativos e implementaciones de lenguaje.
Uses mathematically defined conflict-free replicated data types to ensure all replicas eventually converge to the same state.
Algodeck is an open-source collection of flash cards designed for reviewing algorithms, data structures, and system design concepts, specifically curated for technical interview preparation. The project organizes knowledge into atomic question-and-answer pairs and incorporates spaced repetition scheduling to optimize long-term memory retention. The flash card catalog covers a broad range of computer science topics, including classic sorting algorithms like quicksort and mergesort, data structure operations for arrays, trees, heaps, tries, and graphs, as well as bit manipulation techniques for
Explains CRDT-based convergence for conflict-free replicated data types.
cr-sqlite is a multi-master database replication system that uses conflict-free replicated data types to ensure eventual consistency across distributed nodes. It provides the core capabilities for offline-first data synchronization, allowing multiple database instances to merge concurrent updates and reach a consistent state. The project distinguishes itself through a combination of CRDT-based data replication and a WASM-based database engine, enabling full SQL execution and state persistence within web browsers. It supports peer-to-peer replication and cross-tab synchronization, utilizing ca
Ensures all replicas eventually reach the same state regardless of the order in which updates are received.