Awesome GitHub RepositoriesReplication Control and Policy

Syncthing 是一个去中心化的文件同步引擎，通过点对点网状网络在多个设备间保持一致的数据状态。它作为后台守护进程运行，在受信任的节点之间自动复制文件的创建、修改和删除，无需中央服务器。通过利用内容可寻址块索引和块级增量同步，系统仅识别并传输文件的修改部分，从而确保在异构环境中高效地传播数据。 该项目以安全优先的架构著称，依赖相互 TLS 认证来验证设备身份，确保所有连接在加密上绑定到受信任的证书指纹。它支持灵活的同步模式，包括双向复制、用于备份的单向镜像以及基于引用的强制执行。为了增加隐私性，系统为不受信任的设备提供了文件夹级加密，并允许对网络流量进行细粒度控制，包括限制操作仅在本地网络进行或利用中继基础设施进行 NAT 穿透。 除了核心复制功能外，该平台还提供全面的管理工具，包括用于监控连接状态和吞吐量的 Web 仪表板，以及用于高级配置的命令行界面。它包含强大的版本控制策略以防止数据丢失，并通过原生服务集成和可观测性指标支持复杂的部署场景。该软件专为跨平台兼容性而设计，可通过标准包管理器或容器化环境安装。

Redis is an in-memory, key-value database designed to provide sub-millisecond latency for read and write operations. It functions as a versatile data platform, serving as a distributed cache, a message broker, a NoSQL document store, and a vector database. The system utilizes an event-driven, single-threaded loop to process requests efficiently, while maintaining data durability through append-only persistence logs and asynchronous snapshotting mechanisms. What distinguishes Redis is its ability to handle complex data structures—including strings, hashes, lists, sets, and sorted sets—alongsid

Harbor is a self-hosted, enterprise-grade container registry platform designed to store, sign, and scan container images and cloud-native artifacts. It provides a centralized repository that integrates directly with Kubernetes environments to manage the full lifecycle of software artifacts, from initial storage to production deployment. The platform distinguishes itself through a focus on security, governance, and multi-site availability. It features a pluggable vulnerability scanning framework that allows for the integration of various security engines, alongside content trust mechanisms tha

This project is a reactive, offline-first NoSQL database engine designed for JavaScript applications. It provides a robust framework for managing application state by synchronizing data across browsers, mobile devices, and server-side runtimes. By treating local storage as the primary source of truth, it enables applications to remain functional without network connectivity, automatically reconciling changes with remote backends once a connection is restored. The database distinguishes itself through a modular architecture that supports cross-environment synchronization and high-performance d

Vector is a high-performance observability data pipeline designed to collect, transform, and route logs, metrics, and traces across distributed infrastructure. It functions as a modular engine that decouples data ingestion from processing and transmission, utilizing a component-based architecture to connect diverse sources to multiple destinations. The project distinguishes itself through a focus on reliability and flow control. It implements backpressure-aware data movement to prevent data loss during traffic spikes and utilizes disk-backed event buffering to ensure durability during network

Temporal is a distributed workflow orchestration engine designed to manage fault-tolerant, stateful, and long-running background processes. It functions as a platform for coordinating complex cross-service operations, ensuring consistency and reliability in distributed environments by decoupling workflow orchestration from task execution. The platform distinguishes itself through a deterministic, event-sourced execution model that reconstructs workflow state by re-executing code from an immutable event log. This approach isolates non-deterministic side effects into managed activities, allowin

PouchDB is a JavaScript NoSQL document database that runs directly in the browser. It serves as an offline-first data store that allows applications to save state and user data locally using persistent storage. The database is compatible with CouchDB, implementing its API to enable synchronization between browser environments and remote servers. This allows for cross-device data syncing and the development of local-first software that operates without a constant internet connection. The project covers data storage and synchronization capabilities, including the ability to migrate database sc

Mackup is a dotfile backup manager and application settings backup tool designed to keep software configuration files consistent across multiple computers. It functions by copying home directory configuration files into a centralized storage folder for preservation, restoration, and synchronization. The utility utilizes a symbolic link manager to replace local configuration files with symlinks pointing to a synchronized folder, enabling real-time updates. It supports cloud storage integration, allowing these configuration directories to be mirrored to remote backends for cross-machine environ

This project is a synchronization plugin that mirrors notes, settings, and vault data across multiple devices. It functions as a self-hosted vault synchronizer, allowing users to maintain a personal knowledge base using a user-owned server. The system utilizes a CouchDB synchronization layer to maintain consistent document states across peers. Security is handled through end-to-end encryption, which encrypts vault content locally before transmission to ensure privacy on remote storage. The replication model supports both self-hosted data replication and peer-to-peer data transfer. It manages

This project is a comprehensive knowledge base and study resource designed for mastering technical interviews. It provides structured guides, roadmaps, and curricula focused on data structures, algorithms, system design, and frontend engineering to help candidates prepare for software engineering screenings. The repository distinguishes itself by offering a holistic approach to professional advancement. Beyond technical drills, it includes a career development handbook covering resume optimization, salary benchmarking, and strategic negotiation coaching. It also provides detailed methodologie

Patroni is a high availability manager and cluster orchestrator for PostgreSQL. It functions as an automatic failover controller and replication manager that ensures continuous database availability by automating leader election and promoting standby nodes during failures. The system maintains a consistent cluster state by acting as a distributed consensus coordinator. It synchronizes configuration and manages leader elections through integration with distributed configuration stores such as etcd, ZooKeeper, or Consul. Its broader capabilities include managing both synchronous and asynchrono

language-ext is a functional programming framework for C# that provides a suite of immutable data structures and monadic types. It enables the implementation of pure functional programming patterns, utilizing containers to manage side effects, optional values, and error handling. The library is distinguished by its advanced concurrency and state management tools, including a software transactional memory system and lock-free atomic references. It also provides specialized utilities for distributed systems, such as vector clocks for causality tracking and deterministic data conflict resolution

Kanidm is a centralized identity management server designed to handle authentication, authorization, and directory services across distributed infrastructure. It provides a comprehensive framework for managing human and service accounts, utilizing a schema-driven database to store identity records, group memberships, and system attributes. The platform supports a wide range of authentication methods, including passkeys, passwords, and standard protocols like OAuth2, OIDC, LDAP, and RADIUS. The system distinguishes itself through a granular access control engine that enforces security policies

Hoodie 是一个数据同步框架和离线优先的 JavaScript 后端，旨在保持客户端数据存储与远程后端同步。它提供了一个本地优先的持久化层，通过抽象客户端数据库，允许应用程序在离线时保持功能。 该系统具有 NoSQL 后端接口，无需自定义服务端样板代码即可与远程数据存储进行交互。这由一个模块化的可插拔后端适配器驱动系统支持，该系统将同步层连接到各种远程数据库提供商。 该框架管理客户端数据同步和本地优先持久化，以确保跨设备的一致性。它涵盖了后端服务器的部署以处理数据持久化，以及为 Web 和移动应用程序创建离线 API。

Sanoid is a policy-driven tool for ZFS backup automation, snapshot management, dataset replication, and storage monitoring. It manages the automated lifecycle of filesystem snapshots by translating configurable retention policies into specific creation and pruning commands. The tool provides asynchronous incremental replication of datasets between local or remote hosts using secure tunnels. It differentiates itself by using a structured configuration system to apply standardized snapshot policies across nested filesystem hierarchies through recursive dataset traversal. The software covers st

Olric is a distributed data grid and in-memory key-value store that partitions and replicates data across a cluster of servers. It serves as a shared memory system for managing distributed maps, performing atomic operations, and acting as an in-memory data cache. The system provides a distributed locking mechanism for concurrency control and a pub-sub messaging system that broadcasts and routes messages over named channels across the cluster. The platform covers wide-ranging capabilities including cluster management and orchestration, data replication with configurable quorums, and automated

This project is a reference library of architectural blueprints, study materials, and design patterns for building scalable, high-availability distributed systems. It serves as a technical guide for scalability engineering, providing structural solutions for common engineering challenges. The repository focuses on distributed systems design, covering essential patterns for data replication, consensus algorithms, and transaction management. It distinguishes itself by offering detailed blueprints for specialized domains, including real-time data streaming, large-scale data storage, and high-ava

The reverse-linear-sync-engine is a data synchronization framework designed to manage distributed application state. It provides a system for tracking local data mutations, resolving discrepancies between multiple sources, and maintaining consistency across connected clients through a centralized transaction-based model. The engine distinguishes itself by integrating reactive state observation with a transaction history stack. This combination allows the framework to automatically refresh interface components when data changes while simultaneously enabling precise undo and redo functionality.

Couchbase Lite for iOS is an embedded NoSQL database engine designed for native mobile and desktop applications. It functions as a library within the application process, providing local document storage and structured querying capabilities that allow software to remain fully functional and responsive without an active internet connection. The library distinguishes itself through a replication engine that synchronizes local database changes with a central server to maintain consistent state across multiple devices. This synchronization process utilizes a delta-based protocol to transmit only