13 dépôts
Theoretical frameworks for understanding consistency and availability trade-offs in distributed systems.
Distinguishing note: Focuses on extensions like PACELC, distinct from basic CAP theorem concepts.
Explore 13 awesome GitHub repositories matching software engineering & architecture · Distributed Consistency Models. Refine with filters or upvote what's useful.
Developer Roadmap est une plateforme pilotée par la communauté qui fournit des parcours d'apprentissage structurés basés sur des graphes pour le génie logiciel. Elle sert de dépôt de connaissances complet où les domaines techniques sont organisés en séquences visuelles pour guider l'acquisition de compétences professionnelles et la croissance de carrière. Le projet se distingue par un écosystème collaboratif qui permet aux utilisateurs de contribuer à des roadmaps, d'organiser les meilleures pratiques de l'industrie et de maintenir des profils professionnels. Il intègre des cadres d'évaluation diagnostique pour évaluer la compétence technique, aidant les développeurs à identifier les lacunes en matière de connaissances et à se préparer aux entretiens professionnels grâce à des séquences d'apprentissage ciblées. Au-delà de ses capacités de cartographie de base, la plateforme propose des idées de projets pratiques et du tutorat interactif pour renforcer les concepts d'ingénierie. Elle offre un espace centralisé pour que la communauté puisse partager des ressources, suivre le développement progressif des compétences et naviguer dans des paysages techniques complexes.
Evaluates architectural trade-offs between consistency, availability, and partition tolerance in distributed environments.
This project is a comprehensive educational resource focused on the principles, patterns, and trade-offs required to design scalable, reliable, and high-performance distributed systems. It provides a structured curriculum that covers the fundamental architectural strategies necessary for building modern software infrastructure, ranging from high-level system decomposition to low-level networking and data management. The repository distinguishes itself by offering deep dives into complex architectural patterns, such as microservices-based decomposition, event-driven communication, and command-
Explains the PACELC theorem as an extension of CAP for distributed consistency.
Seata is a distributed transaction coordinator and consistency framework designed to maintain data integrity across multiple microservices. It functions as a manager that synchronizes state across separate databases to ensure atomic commits or rollbacks of global transactions. The project provides a toolkit for implementing distributed transaction patterns, using a two-phase commit protocol and centralized status tracking to prevent data anomalies. It orchestrates eventual consistency through state-machine-based tracking and message-driven coordination to handle timeouts and failures in distr
Manages the complex process of rolling back distributed changes when a global transaction fails.
Eureka is a service registry and discovery server that serves as a coordination tool for microservices. It provides a distributed service registry where instances record their network locations and health status to enable dynamic communication without the use of hardcoded addresses. The system functions as a client-side load balancing framework, providing location data to consumers so they can distribute network traffic across available instances. It employs a heartbeat-based health monitor to track instance availability and automatically removes unresponsive nodes from the registry to manage
Employs an eventual consistency model to prioritize availability and partition tolerance across the registry cluster.
dtm is a distributed transaction framework and polyglot transaction coordinator designed to maintain data consistency across microservices. It functions as a Saga orchestration engine and a two-phase message coordinator, ensuring that multi-service operations either succeed completely or roll back to a consistent state. The project distinguishes itself by supporting multiple consistency patterns, including Saga, TCC, XA, and outbox patterns, allowing users to select the appropriate model for their specific application requirements. It provides a polyglot integration layer via HTTP and gRPC, e
Records completed steps and executes compensating actions to restore a consistent state when a distributed operation fails.
YugabyteDB is a distributed SQL database and relational data store designed for horizontal scalability and high availability across multiple nodes or regions. It functions as a cloud-native system that ensures continuous availability and supports PostgreSQL compatible query languages and drivers. The system includes specialized capabilities as a vector database for AI, utilizing high-dimensional indexing to perform similarity searches. It is engineered as a multi-region cloud database that synchronizes data across different geographic locations to maintain global availability. The project co
Provides capabilities to analyze the distributed state and verify database consistency across nodes.
This project provides educational materials and courseware focused on the theoretical and practical foundations of distributed systems design. It serves as a comprehensive curriculum covering the disciplines of consensus, data consistency, reliability engineering, and scalability. The instructional content focuses on achieving cluster agreement through consensus algorithms and managing system-wide state via coordination frameworks. It includes a dedicated guide to data theory, exploring replication strategies, consistency models, and data convergence. The courseware covers a broad capability
Presents theoretical frameworks for understanding consistency models from causal and sequential to serializability.
This project is a framework for training and sampling generative models designed to produce high-quality images in few steps. It provides implementations for image generation models that transform random noise into structured visual data through an optimized sampling process. The system specializes in accelerating image generation through consistency distillation and consistency training. It includes tools to transform pre-trained diffusion models into faster versions by distilling knowledge from a teacher model into a student model, as well as methods to train consistency models from scratch
Reduces the temporal cost of image creation by training student models to mimic teacher models.
Algodeck is an open-source collection of flash cards designed for reviewing algorithms, data structures, and system design concepts, specifically curated for technical interview preparation. The project organizes knowledge into atomic question-and-answer pairs and incorporates spaced repetition scheduling to optimize long-term memory retention. The flash card catalog covers a broad range of computer science topics, including classic sorting algorithms like quicksort and mergesort, data structure operations for arrays, trees, heaps, tries, and graphs, as well as bit manipulation techniques for
Covers PACELC trade-off framework for consistency, availability, and latency decisions.
Disconf est une plateforme de gestion de configuration distribuée qui fournit un dépôt centralisé basé sur le cloud pour stocker et synchroniser des fichiers de configuration et des paramètres sur plusieurs environnements. Il fonctionne comme un service de configuration dynamique qui met à jour les paramètres d'application et déclenche des rappels immédiatement lorsque les valeurs changent, sans nécessiter de redémarrage du système. Le projet permet la distribution d'actifs de configuration partagés sur plusieurs projets, permettant la gestion en masse des paramètres sur divers environnements cibles. Il utilise un système de diffusion basé sur le push pour synchroniser les changements en temps réel. Pour assurer la stabilité du système, la plateforme inclut un validateur de cohérence de configuration qui effectue des vérifications d'arrière-plan planifiées pour vérifier que les paramètres système actifs restent cohérents avec la source centrale.
Performs background checks to detect and report configuration inconsistencies between active applications and the central source.
LongCat-Video est une collection de modèles spécialisés pour la synthèse vidéo, dotée d'une architecture basée sur un grand modèle de langage pour créer des vidéos haute résolution à partir de textes, d'images ou de séquences existantes. Il inclut des systèmes dédiés pour la génération texte-vers-vidéo, l'animation image-vers-vidéo et la création d'avatars parlants. Le projet fournit des capacités spécifiques pour étendre la durée des clips existants via un modèle de continuation vidéo qui prédit les images suivantes. Il permet également la synchronisation des mouvements des lèvres des personnages avec des invites audio et textuelles pour produire des vidéos parlantes. Le système intègre diverses techniques d'optimisation pour gérer l'efficacité de la génération, incluant l'échantillonnage par distillation et la quantification pour réduire l'utilisation de la mémoire et la latence d'inférence. Des composants structurels supplémentaires couvrent la compression dans l'espace latent et la modélisation spatio-temporelle pour maintenir la cohérence à travers le temps et l'espace.
Reduces generation latency and memory usage through distillation and quantization.
This project is a technical programming guide and educational resource focused on Go internals, runtime mechanisms, and advanced language features. It provides detailed conceptual analysis of the language's execution model, including its scheduler, memory escape analysis, and garbage collection mechanisms. The material distinguishes itself through deep dives into high-concurrency system design, exploring the implementation of worker pools and communication channels. It also covers low-level network programming with a focus on I/O multiplexing and TCP state management, alongside a study of dis
Analyzes the implementation of eventual consistency as a theoretical framework for distributed data convergence.
docetl is an AI-powered document ETL tool and map-reduce orchestrator designed to transform large collections of unstructured documents into structured, queryable tables using language models. It provides a declarative pipeline framework for extracting, cleaning, and transforming data from sources such as PDFs and text files into predefined schemas. The project distinguishes itself through a semantic data integration suite that enables joining datasets and resolving duplicate entities based on embedding-based similarity. It includes an interactive prompt playground for developing and optimizi
Provides tools to identify the most cost-effective and accurate pipeline configurations from a set of results.