13 个仓库
Theoretical frameworks for understanding consistency and availability trade-offs in distributed systems.
Distinguishing note: Focuses on extensions like PACELC, distinct from basic CAP theorem concepts.
Explore 13 awesome GitHub repositories matching software engineering & architecture · Distributed Consistency Models. Refine with filters or upvote what's useful.
Developer Roadmap 是一个社区驱动的平台,提供结构化的、基于图谱的软件工程学习路径。它作为一个综合知识仓库,将技术领域组织成可视化序列,以指导专业技能获取和职业成长。 该项目通过协作生态系统脱颖而出,使用户能够贡献路线图、策划行业最佳实践并维护个人职业档案。它集成了诊断评估框架来评估技术熟练度,帮助开发者识别知识缺口,并通过有针对性的学习序列为专业面试做准备。 除了核心映射能力外,该平台还提供实用的项目创意和交互式辅导,以巩固工程概念。它为社区提供了一个共享资源、跟踪技能进步和导航复杂技术领域的中心化空间。
Evaluates architectural trade-offs between consistency, availability, and partition tolerance in distributed environments.
This project is a comprehensive educational resource focused on the principles, patterns, and trade-offs required to design scalable, reliable, and high-performance distributed systems. It provides a structured curriculum that covers the fundamental architectural strategies necessary for building modern software infrastructure, ranging from high-level system decomposition to low-level networking and data management. The repository distinguishes itself by offering deep dives into complex architectural patterns, such as microservices-based decomposition, event-driven communication, and command-
Explains the PACELC theorem as an extension of CAP for distributed consistency.
Seata is a distributed transaction coordinator and consistency framework designed to maintain data integrity across multiple microservices. It functions as a manager that synchronizes state across separate databases to ensure atomic commits or rollbacks of global transactions. The project provides a toolkit for implementing distributed transaction patterns, using a two-phase commit protocol and centralized status tracking to prevent data anomalies. It orchestrates eventual consistency through state-machine-based tracking and message-driven coordination to handle timeouts and failures in distr
Manages the complex process of rolling back distributed changes when a global transaction fails.
Eureka is a service registry and discovery server that serves as a coordination tool for microservices. It provides a distributed service registry where instances record their network locations and health status to enable dynamic communication without the use of hardcoded addresses. The system functions as a client-side load balancing framework, providing location data to consumers so they can distribute network traffic across available instances. It employs a heartbeat-based health monitor to track instance availability and automatically removes unresponsive nodes from the registry to manage
Employs an eventual consistency model to prioritize availability and partition tolerance across the registry cluster.
dtm is a distributed transaction framework and polyglot transaction coordinator designed to maintain data consistency across microservices. It functions as a Saga orchestration engine and a two-phase message coordinator, ensuring that multi-service operations either succeed completely or roll back to a consistent state. The project distinguishes itself by supporting multiple consistency patterns, including Saga, TCC, XA, and outbox patterns, allowing users to select the appropriate model for their specific application requirements. It provides a polyglot integration layer via HTTP and gRPC, e
Records completed steps and executes compensating actions to restore a consistent state when a distributed operation fails.
YugabyteDB is a distributed SQL database and relational data store designed for horizontal scalability and high availability across multiple nodes or regions. It functions as a cloud-native system that ensures continuous availability and supports PostgreSQL compatible query languages and drivers. The system includes specialized capabilities as a vector database for AI, utilizing high-dimensional indexing to perform similarity searches. It is engineered as a multi-region cloud database that synchronizes data across different geographic locations to maintain global availability. The project co
Provides capabilities to analyze the distributed state and verify database consistency across nodes.
This project provides educational materials and courseware focused on the theoretical and practical foundations of distributed systems design. It serves as a comprehensive curriculum covering the disciplines of consensus, data consistency, reliability engineering, and scalability. The instructional content focuses on achieving cluster agreement through consensus algorithms and managing system-wide state via coordination frameworks. It includes a dedicated guide to data theory, exploring replication strategies, consistency models, and data convergence. The courseware covers a broad capability
Presents theoretical frameworks for understanding consistency models from causal and sequential to serializability.
This project is a framework for training and sampling generative models designed to produce high-quality images in few steps. It provides implementations for image generation models that transform random noise into structured visual data through an optimized sampling process. The system specializes in accelerating image generation through consistency distillation and consistency training. It includes tools to transform pre-trained diffusion models into faster versions by distilling knowledge from a teacher model into a student model, as well as methods to train consistency models from scratch
Reduces the temporal cost of image creation by training student models to mimic teacher models.
Algodeck is an open-source collection of flash cards designed for reviewing algorithms, data structures, and system design concepts, specifically curated for technical interview preparation. The project organizes knowledge into atomic question-and-answer pairs and incorporates spaced repetition scheduling to optimize long-term memory retention. The flash card catalog covers a broad range of computer science topics, including classic sorting algorithms like quicksort and mergesort, data structure operations for arrays, trees, heaps, tries, and graphs, as well as bit manipulation techniques for
Covers PACELC trade-off framework for consistency, availability, and latency decisions.
Disconf is a distributed configuration management platform that provides a centralized cloud-based repository for storing and syncing configuration files and settings across multiple environments. It functions as a dynamic configuration service that updates application settings and triggers callbacks immediately when values change without requiring a system restart. The project enables the distribution of shared configuration assets across multiple projects, allowing for the bulk management of settings across various target environments. It utilizes a push-based broadcast system to synchroniz
Performs background checks to detect and report configuration inconsistencies between active applications and the central source.
LongCat-Video 是一系列专门用于视频合成的模型集合,采用基于大语言模型的架构,用于从文本、图像或现有序列创建高分辨率视频。它包括用于文本生成视频、图像生成视频动画以及创建数字人头像的专用系统。 该项目提供了通过视频延续模型延长现有剪辑长度的特定功能,该模型可以预测后续帧。它还支持将角色口型与音频和文本提示同步,以制作说话视频。 该系统结合了多种优化技术来管理生成效率,包括基于蒸馏的采样和量化,以减少内存使用和推理延迟。其他结构组件涵盖了潜在空间压缩和时空建模,以保持跨时间和空间的连贯性。
Reduces generation latency and memory usage through distillation and quantization.
这是一个技术编程指南和教育资源,专注于 Go 内部机制、运行时机制和高级语言特性。它提供了对该语言执行模型的详细概念分析,包括其调度器、内存逃逸分析和垃圾回收机制。 该材料通过对高并发系统设计的深入探讨而脱颖而出,探索了工作池和通信通道的实现。它还涵盖了低级网络编程,重点是 I/O 多路复用和 TCP 状态管理,以及应用 CAP 和 BASE 定理到可扩展服务的分布式系统理论研究。 范围扩展到通过 CPU 和内存分析进行性能优化、模块依赖管理和完整性验证,以及依赖倒置等软件架构原则的应用。它进一步检查了类型系统的多态行为和自动化内存管理的内部机制。
Analyzes the implementation of eventual consistency as a theoretical framework for distributed data convergence.
docetl is an AI-powered document ETL tool and map-reduce orchestrator designed to transform large collections of unstructured documents into structured, queryable tables using language models. It provides a declarative pipeline framework for extracting, cleaning, and transforming data from sources such as PDFs and text files into predefined schemas. The project distinguishes itself through a semantic data integration suite that enables joining datasets and resolving duplicate entities based on embedding-based similarity. It includes an interactive prompt playground for developing and optimizi
Provides tools to identify the most cost-effective and accurate pipeline configurations from a set of results.