13 repositorios
Theoretical frameworks for understanding consistency and availability trade-offs in distributed systems.
Distinguishing note: Focuses on extensions like PACELC, distinct from basic CAP theorem concepts.
Explore 13 awesome GitHub repositories matching software engineering & architecture · Distributed Consistency Models. Refine with filters or upvote what's useful.
Developer Roadmap es una plataforma impulsada por la comunidad que proporciona rutas de aprendizaje estructuradas basadas en grafos para la ingeniería de software. Sirve como un repositorio de conocimiento integral donde los dominios técnicos se organizan en secuencias visuales para guiar la adquisición de habilidades profesionales y el crecimiento profesional. El proyecto se distingue por un ecosistema colaborativo que permite a los usuarios contribuir con roadmaps, curar las mejores prácticas de la industria y mantener perfiles profesionales. Integra marcos de evaluación de diagnóstico para evaluar la competencia técnica, ayudando a los desarrolladores a identificar brechas de conocimiento y prepararse para entrevistas profesionales a través de secuencias de aprendizaje específicas. Más allá de sus capacidades principales de mapeo, la plataforma ofrece ideas de proyectos prácticos y tutoría interactiva para reforzar los conceptos de ingeniería. Proporciona un espacio centralizado para que la comunidad comparta recursos, rastree el desarrollo progresivo de habilidades y navegue por paisajes técnicos complejos.
Evaluates architectural trade-offs between consistency, availability, and partition tolerance in distributed environments.
This project is a comprehensive educational resource focused on the principles, patterns, and trade-offs required to design scalable, reliable, and high-performance distributed systems. It provides a structured curriculum that covers the fundamental architectural strategies necessary for building modern software infrastructure, ranging from high-level system decomposition to low-level networking and data management. The repository distinguishes itself by offering deep dives into complex architectural patterns, such as microservices-based decomposition, event-driven communication, and command-
Explains the PACELC theorem as an extension of CAP for distributed consistency.
Seata is a distributed transaction coordinator and consistency framework designed to maintain data integrity across multiple microservices. It functions as a manager that synchronizes state across separate databases to ensure atomic commits or rollbacks of global transactions. The project provides a toolkit for implementing distributed transaction patterns, using a two-phase commit protocol and centralized status tracking to prevent data anomalies. It orchestrates eventual consistency through state-machine-based tracking and message-driven coordination to handle timeouts and failures in distr
Manages the complex process of rolling back distributed changes when a global transaction fails.
Eureka is a service registry and discovery server that serves as a coordination tool for microservices. It provides a distributed service registry where instances record their network locations and health status to enable dynamic communication without the use of hardcoded addresses. The system functions as a client-side load balancing framework, providing location data to consumers so they can distribute network traffic across available instances. It employs a heartbeat-based health monitor to track instance availability and automatically removes unresponsive nodes from the registry to manage
Employs an eventual consistency model to prioritize availability and partition tolerance across the registry cluster.
dtm is a distributed transaction framework and polyglot transaction coordinator designed to maintain data consistency across microservices. It functions as a Saga orchestration engine and a two-phase message coordinator, ensuring that multi-service operations either succeed completely or roll back to a consistent state. The project distinguishes itself by supporting multiple consistency patterns, including Saga, TCC, XA, and outbox patterns, allowing users to select the appropriate model for their specific application requirements. It provides a polyglot integration layer via HTTP and gRPC, e
Records completed steps and executes compensating actions to restore a consistent state when a distributed operation fails.
YugabyteDB is a distributed SQL database and relational data store designed for horizontal scalability and high availability across multiple nodes or regions. It functions as a cloud-native system that ensures continuous availability and supports PostgreSQL compatible query languages and drivers. The system includes specialized capabilities as a vector database for AI, utilizing high-dimensional indexing to perform similarity searches. It is engineered as a multi-region cloud database that synchronizes data across different geographic locations to maintain global availability. The project co
Provides capabilities to analyze the distributed state and verify database consistency across nodes.
This project provides educational materials and courseware focused on the theoretical and practical foundations of distributed systems design. It serves as a comprehensive curriculum covering the disciplines of consensus, data consistency, reliability engineering, and scalability. The instructional content focuses on achieving cluster agreement through consensus algorithms and managing system-wide state via coordination frameworks. It includes a dedicated guide to data theory, exploring replication strategies, consistency models, and data convergence. The courseware covers a broad capability
Presents theoretical frameworks for understanding consistency models from causal and sequential to serializability.
This project is a framework for training and sampling generative models designed to produce high-quality images in few steps. It provides implementations for image generation models that transform random noise into structured visual data through an optimized sampling process. The system specializes in accelerating image generation through consistency distillation and consistency training. It includes tools to transform pre-trained diffusion models into faster versions by distilling knowledge from a teacher model into a student model, as well as methods to train consistency models from scratch
Reduces the temporal cost of image creation by training student models to mimic teacher models.
Algodeck is an open-source collection of flash cards designed for reviewing algorithms, data structures, and system design concepts, specifically curated for technical interview preparation. The project organizes knowledge into atomic question-and-answer pairs and incorporates spaced repetition scheduling to optimize long-term memory retention. The flash card catalog covers a broad range of computer science topics, including classic sorting algorithms like quicksort and mergesort, data structure operations for arrays, trees, heaps, tries, and graphs, as well as bit manipulation techniques for
Covers PACELC trade-off framework for consistency, availability, and latency decisions.
Disconf es una plataforma de gestión de configuración distribuida que proporciona un repositorio centralizado en la nube para almacenar y sincronizar archivos de configuración y ajustes en múltiples entornos. Funciona como un servicio de configuración dinámica que actualiza los ajustes de la aplicación y activa callbacks inmediatamente cuando los valores cambian, sin requerir un reinicio del sistema. El proyecto permite la distribución de activos de configuración compartidos entre múltiples proyectos, permitiendo la gestión masiva de ajustes en varios entornos objetivo. Utiliza un sistema de difusión basado en push para sincronizar cambios en tiempo real. Para garantizar la estabilidad del sistema, la plataforma incluye un validador de consistencia de configuración que realiza comprobaciones programadas en segundo plano para verificar que los ajustes activos del sistema permanezcan consistentes con la fuente central.
Performs background checks to detect and report configuration inconsistencies between active applications and the central source.
LongCat-Video es una colección de modelos especializados para síntesis de video, que cuenta con una arquitectura basada en modelos de lenguaje grandes para crear videos de alta resolución a partir de texto, imágenes o secuencias existentes. Incluye sistemas dedicados para la generación de texto a video, animación de imagen a video y la creación de avatares parlantes. El proyecto proporciona capacidades específicas para extender la duración de clips existentes a través de un modelo de continuación de video que predice los fotogramas subsiguientes. También permite la sincronización de los movimientos labiales de los personajes con audio y prompts de texto para producir videos hablados. El sistema incorpora varias técnicas de optimización para gestionar la eficiencia de la generación, incluyendo muestreo basado en destilación y cuantización para reducir el uso de memoria y la latencia de inferencia. Los componentes estructurales adicionales cubren la compresión en el espacio latente y el modelado espacio-temporal para mantener la consistencia a través del tiempo y el espacio.
Reduces generation latency and memory usage through distillation and quantization.
This project is a technical programming guide and educational resource focused on Go internals, runtime mechanisms, and advanced language features. It provides detailed conceptual analysis of the language's execution model, including its scheduler, memory escape analysis, and garbage collection mechanisms. The material distinguishes itself through deep dives into high-concurrency system design, exploring the implementation of worker pools and communication channels. It also covers low-level network programming with a focus on I/O multiplexing and TCP state management, alongside a study of dis
Analyzes the implementation of eventual consistency as a theoretical framework for distributed data convergence.
docetl is an AI-powered document ETL tool and map-reduce orchestrator designed to transform large collections of unstructured documents into structured, queryable tables using language models. It provides a declarative pipeline framework for extracting, cleaning, and transforming data from sources such as PDFs and text files into predefined schemas. The project distinguishes itself through a semantic data integration suite that enables joining datasets and resolving duplicate entities based on embedding-based similarity. It includes an interactive prompt playground for developing and optimizi
Provides tools to identify the most cost-effective and accurate pipeline configurations from a set of results.