Awesome GitHub RepositoriesReplication Control and Policy

Syncthing est un moteur de synchronisation de fichiers décentralisé qui maintient des états de données cohérents sur plusieurs appareils via un réseau maillé peer-to-peer. Il fonctionne comme un démon en arrière-plan qui réplique automatiquement les créations, modifications et suppressions de fichiers entre des nœuds de confiance sans nécessiter de serveurs centraux. En utilisant l'indexation de blocs adressables par contenu et la synchronisation delta au niveau des blocs, le système identifie et transfère uniquement les segments modifiés des fichiers, assurant une propagation efficace des données dans des environnements hétérogènes. Le projet se distingue par une architecture axée sur la sécurité qui repose sur l'authentification mutuelle TLS pour vérifier l'identité des appareils, garantissant que toutes les connexions sont liées cryptographiquement aux empreintes de certificats de confiance. Il prend en charge des modes de synchronisation flexibles, notamment la réplication bidirectionnelle, la mise en miroir unidirectionnelle pour les sauvegardes et l'application basée sur des références. Pour plus de confidentialité, le système fournit un chiffrement au niveau des dossiers pour les appareils non approuvés et permet un contrôle granulaire du trafic réseau, y compris la possibilité de restreindre les opérations aux réseaux locaux ou d'utiliser une infrastructure de relais pour le franchissement NAT. Au-delà de ses capacités de réplication de base, la plateforme offre des outils de gestion complets, notamment un tableau de bord web pour surveiller l'état de la connexion et le débit, ainsi qu'une interface de ligne de commande pour une configuration avancée. Il inclut des stratégies de versionnage robustes pour protéger contre la perte de données et prend en charge des scénarios de déploiement complexes grâce à une intégration native des services et des métriques d'observabilité. Le logiciel est conçu pour une compatibilité multiplateforme et peut être installé via des gestionnaires de paquets standard ou des environnements conteneurisés.

Redis is an in-memory, key-value database designed to provide sub-millisecond latency for read and write operations. It functions as a versatile data platform, serving as a distributed cache, a message broker, a NoSQL document store, and a vector database. The system utilizes an event-driven, single-threaded loop to process requests efficiently, while maintaining data durability through append-only persistence logs and asynchronous snapshotting mechanisms. What distinguishes Redis is its ability to handle complex data structures—including strings, hashes, lists, sets, and sorted sets—alongsid

Harbor is a self-hosted, enterprise-grade container registry platform designed to store, sign, and scan container images and cloud-native artifacts. It provides a centralized repository that integrates directly with Kubernetes environments to manage the full lifecycle of software artifacts, from initial storage to production deployment. The platform distinguishes itself through a focus on security, governance, and multi-site availability. It features a pluggable vulnerability scanning framework that allows for the integration of various security engines, alongside content trust mechanisms tha

This project is a reactive, offline-first NoSQL database engine designed for JavaScript applications. It provides a robust framework for managing application state by synchronizing data across browsers, mobile devices, and server-side runtimes. By treating local storage as the primary source of truth, it enables applications to remain functional without network connectivity, automatically reconciling changes with remote backends once a connection is restored. The database distinguishes itself through a modular architecture that supports cross-environment synchronization and high-performance d

Vector is a high-performance observability data pipeline designed to collect, transform, and route logs, metrics, and traces across distributed infrastructure. It functions as a modular engine that decouples data ingestion from processing and transmission, utilizing a component-based architecture to connect diverse sources to multiple destinations. The project distinguishes itself through a focus on reliability and flow control. It implements backpressure-aware data movement to prevent data loss during traffic spikes and utilizes disk-backed event buffering to ensure durability during network

Temporal is a distributed workflow orchestration engine designed to manage fault-tolerant, stateful, and long-running background processes. It functions as a platform for coordinating complex cross-service operations, ensuring consistency and reliability in distributed environments by decoupling workflow orchestration from task execution. The platform distinguishes itself through a deterministic, event-sourced execution model that reconstructs workflow state by re-executing code from an immutable event log. This approach isolates non-deterministic side effects into managed activities, allowin

PouchDB is a JavaScript NoSQL document database that runs directly in the browser. It serves as an offline-first data store that allows applications to save state and user data locally using persistent storage. The database is compatible with CouchDB, implementing its API to enable synchronization between browser environments and remote servers. This allows for cross-device data syncing and the development of local-first software that operates without a constant internet connection. The project covers data storage and synchronization capabilities, including the ability to migrate database sc

Mackup is a dotfile backup manager and application settings backup tool designed to keep software configuration files consistent across multiple computers. It functions by copying home directory configuration files into a centralized storage folder for preservation, restoration, and synchronization. The utility utilizes a symbolic link manager to replace local configuration files with symlinks pointing to a synchronized folder, enabling real-time updates. It supports cloud storage integration, allowing these configuration directories to be mirrored to remote backends for cross-machine environ

This project is a synchronization plugin that mirrors notes, settings, and vault data across multiple devices. It functions as a self-hosted vault synchronizer, allowing users to maintain a personal knowledge base using a user-owned server. The system utilizes a CouchDB synchronization layer to maintain consistent document states across peers. Security is handled through end-to-end encryption, which encrypts vault content locally before transmission to ensure privacy on remote storage. The replication model supports both self-hosted data replication and peer-to-peer data transfer. It manages

This project is a comprehensive knowledge base and study resource designed for mastering technical interviews. It provides structured guides, roadmaps, and curricula focused on data structures, algorithms, system design, and frontend engineering to help candidates prepare for software engineering screenings. The repository distinguishes itself by offering a holistic approach to professional advancement. Beyond technical drills, it includes a career development handbook covering resume optimization, salary benchmarking, and strategic negotiation coaching. It also provides detailed methodologie

Patroni is a high availability manager and cluster orchestrator for PostgreSQL. It functions as an automatic failover controller and replication manager that ensures continuous database availability by automating leader election and promoting standby nodes during failures. The system maintains a consistent cluster state by acting as a distributed consensus coordinator. It synchronizes configuration and manages leader elections through integration with distributed configuration stores such as etcd, ZooKeeper, or Consul. Its broader capabilities include managing both synchronous and asynchrono

language-ext is a functional programming framework for C# that provides a suite of immutable data structures and monadic types. It enables the implementation of pure functional programming patterns, utilizing containers to manage side effects, optional values, and error handling. The library is distinguished by its advanced concurrency and state management tools, including a software transactional memory system and lock-free atomic references. It also provides specialized utilities for distributed systems, such as vector clocks for causality tracking and deterministic data conflict resolution

Kanidm is a centralized identity management server designed to handle authentication, authorization, and directory services across distributed infrastructure. It provides a comprehensive framework for managing human and service accounts, utilizing a schema-driven database to store identity records, group memberships, and system attributes. The platform supports a wide range of authentication methods, including passkeys, passwords, and standard protocols like OAuth2, OIDC, LDAP, and RADIUS. The system distinguishes itself through a granular access control engine that enforces security policies

Hoodie est un framework de synchronisation de données et un backend JavaScript offline-first conçu pour maintenir les magasins de données côté client synchronisés avec un backend distant. Il fournit une couche de persistance local-first qui permet aux applications de rester fonctionnelles hors ligne en abstrayant la base de données côté client. Le système dispose d'une interface backend NoSQL qui permet l'interaction avec des magasins de données distants sans nécessiter de code boilerplate côté serveur personnalisé. Ceci est supporté par un système de pilotes modulaire d'adaptateurs backend enfichables qui connectent la couche de synchronisation à divers fournisseurs de bases de données distants. Le framework gère la synchronisation des données côté client et la persistance local-first pour assurer la cohérence à travers les appareils. Il couvre le déploiement de serveurs backend pour gérer la persistance des données et la création d'API hors ligne pour les applications web et mobiles.

Sanoid is a policy-driven tool for ZFS backup automation, snapshot management, dataset replication, and storage monitoring. It manages the automated lifecycle of filesystem snapshots by translating configurable retention policies into specific creation and pruning commands. The tool provides asynchronous incremental replication of datasets between local or remote hosts using secure tunnels. It differentiates itself by using a structured configuration system to apply standardized snapshot policies across nested filesystem hierarchies through recursive dataset traversal. The software covers st

Olric is a distributed data grid and in-memory key-value store that partitions and replicates data across a cluster of servers. It serves as a shared memory system for managing distributed maps, performing atomic operations, and acting as an in-memory data cache. The system provides a distributed locking mechanism for concurrency control and a pub-sub messaging system that broadcasts and routes messages over named channels across the cluster. The platform covers wide-ranging capabilities including cluster management and orchestration, data replication with configurable quorums, and automated

This project is a reference library of architectural blueprints, study materials, and design patterns for building scalable, high-availability distributed systems. It serves as a technical guide for scalability engineering, providing structural solutions for common engineering challenges. The repository focuses on distributed systems design, covering essential patterns for data replication, consensus algorithms, and transaction management. It distinguishes itself by offering detailed blueprints for specialized domains, including real-time data streaming, large-scale data storage, and high-ava

The reverse-linear-sync-engine is a data synchronization framework designed to manage distributed application state. It provides a system for tracking local data mutations, resolving discrepancies between multiple sources, and maintaining consistency across connected clients through a centralized transaction-based model. The engine distinguishes itself by integrating reactive state observation with a transaction history stack. This combination allows the framework to automatically refresh interface components when data changes while simultaneously enabling precise undo and redo functionality.

Couchbase Lite pour iOS est un moteur de base de données NoSQL embarqué conçu pour les applications mobiles et de bureau natives. Il fonctionne comme une bibliothèque au sein du processus d'application, fournissant un stockage de documents local et des capacités de requête structurées qui permettent au logiciel de rester pleinement fonctionnel et réactif sans connexion internet active. La bibliothèque se distingue par un moteur de réplication qui synchronise les changements de base de données locale avec un serveur central pour maintenir un état cohérent sur plusieurs appareils. Ce processus de synchronisation utilise un protocole basé sur les deltas pour transmettre uniquement les portions de documents modifiées, tandis qu'une logique de résolution de conflit automatisée gère les états de données divergents qui se produisent pendant le fonctionnement hors ligne. Le système de stockage utilise un modèle de document JSON et l'indexation B-tree pour gérer les données, soutenu par un contrôle de concurrence multi-version pour permettre des opérations de lecture et d'écriture simultanées. Ces fonctionnalités facilitent le développement hors ligne en garantissant que les informations complexes restent accessibles et performantes directement sur l'appareil.