Awesome GitHub RepositoriesData Consistency Models

Qdrant is a high-performance vector similarity database designed to store, index, and search high-dimensional vectors alongside structured metadata. It functions as a distributed search engine that manages large-scale data clusters, providing low-latency retrieval and complex filtering capabilities. The system is built to serve as a specialized middleware layer, connecting machine learning pipelines and AI agents to persistent storage for intelligent information retrieval and recommendation tasks. The platform distinguishes itself through advanced retrieval techniques, including support for h

Memcached is a high-performance, distributed, in-memory key-value storage and request routing engine. It functions as a volatile data store designed to accelerate dynamic applications by caching objects in RAM, thereby reducing backend database load and providing sub-millisecond response times. The system utilizes a specialized architecture that organizes memory into fixed-size slabs to minimize fragmentation and maximize throughput for high-concurrency workloads. The project distinguishes itself through a multi-threaded, lock-friendly design that scales across CPU cores and supports complex

Hazelcast is a distributed data platform that combines an in-memory data grid with a stream processing engine to support real-time analytics and event-driven applications. It functions as a partitioned, distributed key-value store that replicates data across cluster nodes to provide low-latency access and high availability. The platform also serves as a distributed SQL query engine, allowing users to execute standard SQL statements against both in-memory datasets and external data sources. What distinguishes Hazelcast is its use of a distributed consensus subsystem to maintain strongly consis

Cocoindex is an incremental data processing engine that builds and maintains live indexes for AI agents, with a core focus on codebase indexing and knowledge graph extraction. The engine uses a function-graph execution model where user-defined Python functions are composed into a directed acyclic graph, and it processes data incrementally so only changed source records or code paths are re-computed, avoiding full recomputation at any scale. It supports automatic schema inference from transformation pipeline type annotations and provides full data lineage tracing, tagging every output record wi

Mimir هي قاعدة بيانات للسلاسل الزمنية متعددة المستأجرين ومتجر مقاييس موزع مصمم للقياس عن بُعد القابل للتوسع. تعمل كخلفية متوافقة مع Prometheus، وتوفر تخزيناً طويل الأجل ومحرك استعلام قابل للتوسع لأحجام هائلة من بيانات السلاسل الزمنية. تم بناء النظام للمراقبة متعددة المستأجرين، حيث يعزل بيانات القياس عن بُعد وحدود الموارد للفرق أو المؤسسات المستقلة داخل مجموعة واحدة. ويضمن التوافر العالي والمتانة من خلال تقسيم البيانات ونسخها عبر مجموعة موزعة، مع استخدام تخزين الكائنات للاستمرارية للقضاء على تبعيات قواعد البيانات الخارجية. يغطي المشروع إمكانيات واسعة النطاق بما في ذلك تجميع المقاييس العالمية للتحليل عبر المناطق وتنفيذ الاستعلام الموزع باستخدام التوازي والتخزين المؤقت. كما يدمج أدوات المراقبة مثل التنبيه الموحد، والمراقبة الاصطناعية، وسير عمل حل الحوادث المدعوم بالذكاء الاصطناعي لتسريع استكشاف الأخطاء وإصلاحها. تشمل عناصر التحكم الإدارية حصص موارد المستأجر، وتجاوزات الموارد لكل مستخدم، وتقسيم العمل لضمان عزل عبء العمل.

Grafana Tempo is a high-scale distributed tracing backend and columnar trace database. It serves as an observability data store that persists and queries spans and traces using OpenTelemetry standards, allowing for the analysis of request flows across microservices. The system distinguishes itself by using an object-store based backend with columnar Parquet storage. This architecture enables efficient attribute searching and large-scale data retrieval through dedicated attribute columnization and block-based data partitioning. It includes a specialized TraceQL query engine for filtering trace

java-tron هو تنفيذ Java لعقدة Tron blockchain كاملة. يوفر البنية التحتية الأساسية لتشغيل عقدة شبكة، والتحقق من المعاملات، وإنتاج الكتل. يتضمن المشروع محرك إجماع إثبات الحصة (proof-of-stake)، وقاعدة بيانات دفتر أستاذ موزع، ووقت تشغيل عقد ذكي لإدارة انتقالات الحالة على السلسلة. يتميز النظام بدعمه لعمليات العقد الكاملة والخفيفة، باستخدام لقطات الحالة لتسريع المزامنة وتقليل متطلبات الأجهزة. ويتميز بتجريد قاعدة بيانات متعدد المحركات يسمح بترحيل التخزين، والتقسيم، والتقليم عبر أقراص فيزيائية مختلفة لتحسين الأداء. يغطي البرنامج مجموعة واسعة من قدرات blockchain، بما في ذلك إدارة الأصول الرقمية، وحوكمة الشبكة من خلال انتخابات الممثلين، وتنفيذ المنطق القابل للبرمجة عبر جهاز افتراضي. ويعرض بيانات ووظائف blockchain من خلال بوابة تدعم بروتوكولات HTTP وgRPC وJSON-RPC. يوفر المشروع أدوات لتهيئة عقد الشبكة، ونشر بيئات blockchain خاصة، وإدارة مخازن مفاتيح الحساب المشفرة.

RavenDB is a multi-model NoSQL document database designed for high-performance, ACID-compliant data storage. It persists structured information as schema-flexible JSON documents and utilizes a unit-of-work session pattern to track entity changes and batch modifications into atomic transactions. The platform is built on a distributed architecture that supports horizontal scaling through sharding and ensures high availability via multi-node, master-to-master cluster replication. The database distinguishes itself through a self-optimizing query engine that automatically creates and maintains ind

Trillian is a distributed, multi-tenant verifiable data store that maintains cryptographically verifiable logs and maps using Merkle tree structures. It functions as a scalable backend for transparency logs, providing a system where data integrity is ensured through append-only records and mathematical proofs of inclusion and consistency. The system distinguishes itself by decoupling core storage from application-specific logic through a personality layer, which handles admission criteria and data canonicalization. It employs a consensus-based leader election mechanism for high availability a

This project is a learning platform and study guide focused on the principles of distributed systems and software architecture. It provides a collection of architectural scenarios and technical problem statements designed to help engineers practice system design, capacity planning, and trade-off analysis for high-scale services. The repository distinguishes itself by offering functional prototypes and models for complex engineering challenges. Rather than providing purely theoretical documentation, it includes executable representations of system components—such as storage services, load bala

OpenViking is a multi-tenant context server and knowledge base administration system designed to provide AI agents with persistent long-term memory. It enables the indexing of diverse documents and codebases to support retrieval-augmented generation, allowing agents to recall past interactions, user preferences, and learned experiences across sessions. The project is distinguished by its use of a URI-based virtual filesystem to organize memories, resources, and skills. It implements a tiered context loading system that balances retrieval precision with token budgets by structuring data into a