Awesome GitHub RepositoriesReplication Control and Policy

Syncthing هو محرك مزامنة ملفات لامركزي يحافظ على حالات بيانات متسقة عبر أجهزة متعددة من خلال شبكات الند للند (peer-to-peer). يعمل كخلفية (daemon) تقوم تلقائياً بنسخ عمليات إنشاء الملفات وتعديلها وحذفها بين العقد الموثوقة دون الحاجة إلى خوادم مركزية. من خلال استخدام فهرسة الكتل القابلة للعنونة بالمحتوى ومزامنة دلتا على مستوى الكتلة، يحدد النظام وينقل فقط الأجزاء المعدلة من الملفات، مما يضمن انتشار البيانات بكفاءة عبر البيئات غير المتجانسة. يتميز المشروع ببنية تعطي الأولوية للأمان وتعتمد على مصادقة TLS المتبادلة للتحقق من هوية الجهاز، مما يضمن أن جميع الاتصالات مرتبطة تشفيرياً ببصمات شهادات موثوقة. وهو يدعم أوضاع مزامنة مرنة، بما في ذلك النسخ المتماثل ثنائي الاتجاه، والنسخ المتطابق أحادي الاتجاه للنسخ الاحتياطي، والإنفاذ القائم على المرجع. لمزيد من الخصوصية، يوفر النظام تشفيراً على مستوى المجلد للأجهزة غير الموثوقة ويسمح بتحكم دقيق في حركة مرور الشبكة، بما في ذلك القدرة على تقييد العمليات على الشبكات المحلية أو استخدام بنية تحتية للتتابع لاجتياز NAT. بعيداً عن قدرات النسخ الأساسية، توفر المنصة أدوات إدارة شاملة، بما في ذلك لوحة تحكم قائمة على الويب لمراقبة حالة الاتصال والإنتاجية، بالإضافة إلى واجهة سطر أوامر للتكوين المتقدم. وهي تتضمن استراتيجيات إصدار قوية للحماية من فقدان البيانات وتدعم سيناريوهات النشر المعقدة من خلال تكامل الخدمة الأصلي ومقاييس المراقبة. تم تصميم البرنامج للتوافق عبر الأنظمة الأساسية ويمكن تثبيته عبر مديري الحزم القياسيين أو البيئات الحاوية.

Redis is an in-memory, key-value database designed to provide sub-millisecond latency for read and write operations. It functions as a versatile data platform, serving as a distributed cache, a message broker, a NoSQL document store, and a vector database. The system utilizes an event-driven, single-threaded loop to process requests efficiently, while maintaining data durability through append-only persistence logs and asynchronous snapshotting mechanisms. What distinguishes Redis is its ability to handle complex data structures—including strings, hashes, lists, sets, and sorted sets—alongsid

Harbor is a self-hosted, enterprise-grade container registry platform designed to store, sign, and scan container images and cloud-native artifacts. It provides a centralized repository that integrates directly with Kubernetes environments to manage the full lifecycle of software artifacts, from initial storage to production deployment. The platform distinguishes itself through a focus on security, governance, and multi-site availability. It features a pluggable vulnerability scanning framework that allows for the integration of various security engines, alongside content trust mechanisms tha

This project is a reactive, offline-first NoSQL database engine designed for JavaScript applications. It provides a robust framework for managing application state by synchronizing data across browsers, mobile devices, and server-side runtimes. By treating local storage as the primary source of truth, it enables applications to remain functional without network connectivity, automatically reconciling changes with remote backends once a connection is restored. The database distinguishes itself through a modular architecture that supports cross-environment synchronization and high-performance d

Vector is a high-performance observability data pipeline designed to collect, transform, and route logs, metrics, and traces across distributed infrastructure. It functions as a modular engine that decouples data ingestion from processing and transmission, utilizing a component-based architecture to connect diverse sources to multiple destinations. The project distinguishes itself through a focus on reliability and flow control. It implements backpressure-aware data movement to prevent data loss during traffic spikes and utilizes disk-backed event buffering to ensure durability during network

Temporal is a distributed workflow orchestration engine designed to manage fault-tolerant, stateful, and long-running background processes. It functions as a platform for coordinating complex cross-service operations, ensuring consistency and reliability in distributed environments by decoupling workflow orchestration from task execution. The platform distinguishes itself through a deterministic, event-sourced execution model that reconstructs workflow state by re-executing code from an immutable event log. This approach isolates non-deterministic side effects into managed activities, allowin

PouchDB is a JavaScript NoSQL document database that runs directly in the browser. It serves as an offline-first data store that allows applications to save state and user data locally using persistent storage. The database is compatible with CouchDB, implementing its API to enable synchronization between browser environments and remote servers. This allows for cross-device data syncing and the development of local-first software that operates without a constant internet connection. The project covers data storage and synchronization capabilities, including the ability to migrate database sc

Mackup is a dotfile backup manager and application settings backup tool designed to keep software configuration files consistent across multiple computers. It functions by copying home directory configuration files into a centralized storage folder for preservation, restoration, and synchronization. The utility utilizes a symbolic link manager to replace local configuration files with symlinks pointing to a synchronized folder, enabling real-time updates. It supports cloud storage integration, allowing these configuration directories to be mirrored to remote backends for cross-machine environ

This project is a synchronization plugin that mirrors notes, settings, and vault data across multiple devices. It functions as a self-hosted vault synchronizer, allowing users to maintain a personal knowledge base using a user-owned server. The system utilizes a CouchDB synchronization layer to maintain consistent document states across peers. Security is handled through end-to-end encryption, which encrypts vault content locally before transmission to ensure privacy on remote storage. The replication model supports both self-hosted data replication and peer-to-peer data transfer. It manages

This project is a comprehensive knowledge base and study resource designed for mastering technical interviews. It provides structured guides, roadmaps, and curricula focused on data structures, algorithms, system design, and frontend engineering to help candidates prepare for software engineering screenings. The repository distinguishes itself by offering a holistic approach to professional advancement. Beyond technical drills, it includes a career development handbook covering resume optimization, salary benchmarking, and strategic negotiation coaching. It also provides detailed methodologie

Patroni is a high availability manager and cluster orchestrator for PostgreSQL. It functions as an automatic failover controller and replication manager that ensures continuous database availability by automating leader election and promoting standby nodes during failures. The system maintains a consistent cluster state by acting as a distributed consensus coordinator. It synchronizes configuration and manages leader elections through integration with distributed configuration stores such as etcd, ZooKeeper, or Consul. Its broader capabilities include managing both synchronous and asynchrono

language-ext is a functional programming framework for C# that provides a suite of immutable data structures and monadic types. It enables the implementation of pure functional programming patterns, utilizing containers to manage side effects, optional values, and error handling. The library is distinguished by its advanced concurrency and state management tools, including a software transactional memory system and lock-free atomic references. It also provides specialized utilities for distributed systems, such as vector clocks for causality tracking and deterministic data conflict resolution

Kanidm is a centralized identity management server designed to handle authentication, authorization, and directory services across distributed infrastructure. It provides a comprehensive framework for managing human and service accounts, utilizing a schema-driven database to store identity records, group memberships, and system attributes. The platform supports a wide range of authentication methods, including passkeys, passwords, and standard protocols like OAuth2, OIDC, LDAP, and RADIUS. The system distinguishes itself through a granular access control engine that enforces security policies

Hoodie is a data synchronization framework and offline-first JavaScript backend designed to keep client-side data stores in sync with a remote backend. It provides a local-first persistence layer that allows applications to remain functional while offline by abstracting the client-side database. The system features a NoSQL backend interface that enables interaction with remote data stores without requiring custom server-side boilerplate code. This is supported by a modular driver system of pluggable backend adapters that connect the synchronization layer to various remote database providers.

Sanoid is a policy-driven tool for ZFS backup automation, snapshot management, dataset replication, and storage monitoring. It manages the automated lifecycle of filesystem snapshots by translating configurable retention policies into specific creation and pruning commands. The tool provides asynchronous incremental replication of datasets between local or remote hosts using secure tunnels. It differentiates itself by using a structured configuration system to apply standardized snapshot policies across nested filesystem hierarchies through recursive dataset traversal. The software covers st

Olric is a distributed data grid and in-memory key-value store that partitions and replicates data across a cluster of servers. It serves as a shared memory system for managing distributed maps, performing atomic operations, and acting as an in-memory data cache. The system provides a distributed locking mechanism for concurrency control and a pub-sub messaging system that broadcasts and routes messages over named channels across the cluster. The platform covers wide-ranging capabilities including cluster management and orchestration, data replication with configurable quorums, and automated

This project is a reference library of architectural blueprints, study materials, and design patterns for building scalable, high-availability distributed systems. It serves as a technical guide for scalability engineering, providing structural solutions for common engineering challenges. The repository focuses on distributed systems design, covering essential patterns for data replication, consensus algorithms, and transaction management. It distinguishes itself by offering detailed blueprints for specialized domains, including real-time data streaming, large-scale data storage, and high-ava

The reverse-linear-sync-engine is a data synchronization framework designed to manage distributed application state. It provides a system for tracking local data mutations, resolving discrepancies between multiple sources, and maintaining consistency across connected clients through a centralized transaction-based model. The engine distinguishes itself by integrating reactive state observation with a transaction history stack. This combination allows the framework to automatically refresh interface components when data changes while simultaneously enabling precise undo and redo functionality.

Couchbase Lite for iOS هو محرك قاعدة بيانات NoSQL مضمن مصمم لتطبيقات الهاتف المحمول وسطح المكتب الأصلية. يعمل كمكتبة داخل عملية التطبيق، مما يوفر تخزيناً محلياً للمستندات وقدرات استعلام مهيكلة تسمح للبرمجيات بالبقاء وظيفية بالكامل وسريعة الاستجابة دون اتصال نشط بالإنترنت. تتميز المكتبة بمحرك نسخ متماثل يقوم بمزامنة تغييرات قاعدة البيانات المحلية مع خادم مركزي للحفاظ على حالة متسقة عبر أجهزة متعددة. تستخدم عملية المزامنة هذه بروتوكولاً قائماً على الفرق (delta-based) لنقل أجزاء المستند المعدلة فقط، بينما يدير منطق حل التعارضات التلقائي حالات البيانات المتباينة التي تحدث أثناء التشغيل دون اتصال. يستخدم نظام التخزين نموذج مستند JSON وفهرسة B-tree لإدارة البيانات، مدعوماً بالتحكم في التزامن متعدد الإصدارات لتمكين عمليات القراءة والكتابة المتزامنة. تسهل هذه الميزات التطوير الذي يعتمد على العمل دون اتصال أولاً من خلال ضمان بقاء المعلومات المعقدة قابلة للوصول وذات أداء عالٍ مباشرة على الجهاز.