Awesome GitHub RepositoriesDistributed Systems

This repository serves as a comprehensive machine learning research platform, providing a collection of experimental code, methodologies, and tools designed to advance the state of artificial intelligence. It centers on computational graph execution, enabling automatic differentiation and gradient-based optimization for complex models. The project supports large-scale distributed training, allowing researchers to partition datasets across multiple compute nodes and synchronize parameter updates to handle massive computational workloads. The platform distinguishes itself through its focus on f

Operates large-scale distributed systems managing exabytes of data across global data centers.

SurrealDB is a multi-model database engine designed to store and query document, graph, relational, and vector data within a single ACID-compliant platform. It functions as an AI-native data store, integrating vector search, graph traversal, and machine learning model execution directly into its query layer. By providing a unified declarative query language, the platform eliminates the need for external middleware to synchronize data across different storage models. The platform distinguishes itself through its ability to manage agent memory and complex workflows natively. It allows developer

Distributes database instances across industrial environments from edge devices to cloud infrastructure.

NSQ is a distributed, brokerless messaging platform designed for high-throughput, fault-tolerant communication. By utilizing a decentralized topology, it eliminates single points of failure and allows for horizontal scaling across clusters. The system organizes message streams into topics and channels, effectively decoupling producers from consumers to support both streaming and job-oriented workloads. The platform distinguishes itself through a lookup-service-based discovery mechanism that enables clients to dynamically locate producers at runtime without requiring centralized coordination.

Supports deployment of horizontally scalable, brokerless messaging clusters for streaming and job workloads.

Typesense is a distributed search engine designed to provide sub-millisecond query latency across massive datasets. It functions as both a high-performance indexing and retrieval engine and a comprehensive search experience platform, offering built-in typo tolerance and tools for managing relevance through synonym configuration, result curation, and complex filtering. The platform distinguishes itself by utilizing in-memory indexing to maintain high-throughput data retrieval and integrating vector database capabilities to support semantic similarity searches. It ensures data consistency and h

Scales search infrastructure across multiple nodes to maintain high performance and availability.