# Distributed Systems Learning Resources > Search results for `learn distributed systems with papers and courses` on awesome-repositories.com. 114 total matches; showing the first 50. Explore on the web: https://awesome-repositories.com/q/learn-distributed-systems-with-papers-and-courses **Attribution required: if you use, quote, or summarise this content, you must credit and link back to [this search on awesome-repositories.com](https://awesome-repositories.com/q/learn-distributed-systems-with-papers-and-courses).** ## Results - [distribution/distribution](https://awesome-repositories.com/repository/distribution-distribution.md) (10,479 ⭐) — Distribution is an open-source container image registry that implements the OCI Distribution Specification, enabling any OCI-compatible client to push, pull, and manage container images over standard protocols. It serves as a content distribution toolkit for packaging, shipping, storing, and delivering container content across networked environments, storing and retrieving content by its cryptographic hash for integrity and deduplication. The registry separates image metadata from bulk data to enable efficient validation and partial pulls, and supports resumable blob uploads with chunked transfer for reliable large layer pushes over unstable connections. It organizes container images as a stack of immutable layers identified by digests, authenticates clients using bearer tokens from an external auth service, and can act as a caching proxy that fetches and stores images from upstream registries on first request. The registry runs as a stateless, horizontally scalable server that serves container images via a RESTful HTTP API without maintaining session state, enabling horizontal scaling and the ability to start and stop without data loss. It can be started with a single Docker command and supports standard operations including container image pull, push, and storage. - [ashishps1/awesome-leetcode-resources](https://awesome-repositories.com/repository/ashishps1-awesome-leetcode-resources.md) (15,897 ⭐) — This repository is a comprehensive resource for software engineering career development and technical interview preparation. It provides a structured collection of learning materials, algorithmic patterns, and system design guides designed to assist developers in mastering the core competencies required for professional engineering roles. The project distinguishes itself through a pattern-based content taxonomy that groups diverse technical challenges by underlying algorithmic strategies. This approach allows users to identify and apply reusable solutions during high-pressure assessments. It further supports learning through visual aids, including motion graphics that demonstrate the step-by-step execution of code logic, data structure manipulation, and database query performance. The resource covers a broad spectrum of technical domains, including software engineering fundamentals, object-oriented design, and concurrency mechanisms. It also provides frameworks for system design architecture, offering models for understanding how to build scalable distributed systems, handle high traffic, and manage data replication. Additionally, the repository includes guidance on behavioral interview coaching to help candidates structure their professional experiences into effective narratives. - [avelino/awesome-go](https://awesome-repositories.com/repository/avelino-awesome-go.md) (175,576 ⭐) — This project serves as a comprehensive language ecosystem index, functioning as a centralized, community-curated directory for the Go programming language. It organizes a vast landscape of software components, libraries, and development tools into a structured, navigable hierarchy, enabling developers to efficiently discover resources tailored to specific functional domains. The repository distinguishes itself through a decentralized contribution model, where community-driven updates ensure the index remains current with the rapidly evolving software landscape. Beyond simple resource listing, it acts as a technical knowledge repository, aggregating professional literature, style guides, and best practices to support developer onboarding and professional growth across the entire software development lifecycle. The directory covers a broad capability surface, including essential utilities for distributed systems engineering, application security, data processing, and development productivity. It provides access to specialized tools for database management, web framework integration, testing, and build automation, alongside educational materials that help developers master language-specific architectural patterns. The project is maintained as a static resource aggregation, providing a holistic view of external links and documentation to orient developers within the Go ecosystem. - [bytebytegohq/system-design-101](https://awesome-repositories.com/repository/bytebytegohq-system-design-101.md) (83,491 ⭐) — This project is a centralized engineering knowledge repository that provides a structured curriculum for mastering system design, architectural patterns, and fundamental software development workflows. It serves as a professional development resource for engineers, offering foundational knowledge and real-world case studies to support the design of scalable, secure, and efficient distributed systems. The repository distinguishes itself through a visual-first approach to knowledge synthesis, distilling complex technical concepts into high-density graphical diagrams and succinct illustrations. By employing cross-domain concept mapping and modular topic decomposition, it connects disparate engineering disciplines—such as infrastructure, security, and application layers—into granular, self-contained modules that facilitate rapid mental modeling and targeted learning. The content covers a broad spectrum of technical domains, including API and web development, database scaling strategies, networking protocols, and DevOps deployment pipelines. These educational assets are organized as a static, version-controlled repository, allowing users to consume technical insights asynchronously at their own pace. - [harvard-edge/cs249r_book](https://awesome-repositories.com/repository/harvard-edge-cs249r-book.md) (20,217 ⭐) — This project is a comprehensive educational framework designed to teach the design, deployment, and performance optimization of machine learning systems. It provides a structured curriculum that covers the full stack of artificial intelligence engineering, ranging from the construction of core framework components like tensors and automatic differentiation engines to the orchestration of large-scale distributed training clusters. The platform distinguishes itself through its integration of physics-grounded systems modeling and interactive simulation environments. Users can experiment with distributed training strategies, analyze communication overhead, and perform economic modeling to estimate the total cost of ownership, energy consumption, and reliability of hardware clusters. By combining these analytical tools with hands-on embedded hardware kits and browser-based notebooks, the project enables students to bridge the gap between theoretical architecture and practical deployment on resource-constrained edge devices. Beyond core training, the project offers a broad suite of capabilities for evaluating machine learning operations. This includes tools for assessing inference latency, quantifying environmental impact, and optimizing production workloads across diverse environments. The curriculum is supported by extensive pedagogical resources, including lecture materials, assessment banks, and interview preparation scenarios that focus on hardware selection and parallel scaling strategies. The project is maintained as an open-source repository, providing version-controlled educational content and modular software components that allow for collaborative development and adaptation by the academic community. - [donnemartin/system-design-primer](https://awesome-repositories.com/repository/donnemartin-system-design-primer.md) (353,387 ⭐) — This project is a comprehensive educational resource and study guide focused on distributed systems architecture and backend infrastructure design. It provides a structured curriculum for mastering the principles of scalability, reliability, and performance required to design complex software systems. The repository distinguishes itself by offering a methodical approach to technical interview preparation, incorporating design patterns, architectural trade-offs, and spaced repetition tools to help users retain complex concepts. It emphasizes constraint-driven analysis, teaching users how to evaluate competing requirements like latency, consistency, and availability when drafting architectural designs. The content covers a broad spectrum of system design capabilities, including strategies for database scaling, traffic management, and infrastructure optimization. It details techniques for horizontal scaling, multi-layered caching, asynchronous communication, and service discovery, while also providing frameworks for performing resource estimations and capacity planning. The documentation is organized as a study guide, offering a systematic path through the fundamentals of backend engineering and large-scale system design. - [aphyr/distsys-class](https://awesome-repositories.com/repository/aphyr-distsys-class.md) (9,717 ⭐) — This project provides educational materials and courseware focused on the theoretical and practical foundations of distributed systems design. It serves as a comprehensive curriculum covering the disciplines of consensus, data consistency, reliability engineering, and scalability. The instructional content focuses on achieving cluster agreement through consensus algorithms and managing system-wide state via coordination frameworks. It includes a dedicated guide to data theory, exploring replication strategies, consistency models, and data convergence. The courseware covers a broad capability surface including fault tolerance engineering, scalable data partitioning, and network behavior modeling. It also addresses operational strategies such as chaos engineering, traffic flow control through backpressure, and the implementation of gossip protocols for cluster communication. - [instillai/machine-learning-course](https://awesome-repositories.com/repository/instillai-machine-learning-course.md) (0 ⭐) — ################################################### A Machine Learning Course with Python ################################################### - [awesome-selfhosted/awesome-selfhosted](https://awesome-repositories.com/repository/awesome-selfhosted-awesome-selfhosted.md) (299,516 ⭐) — This project is a community-curated directory of open-source software designed for deployment in private server environments and home labs. It serves as a comprehensive resource for discovering independent, self-hosted alternatives to mainstream cloud services, enabling users to maintain full data ownership and control over their digital infrastructure. The directory is structured through a hierarchical taxonomy that organizes a vast collection of applications into logical categories, ranging from media management and data analytics to private communication and team productivity tools. It distinguishes itself through a collaborative peer-review process, where community members validate the quality and relevance of each submission to ensure the directory remains accurate and reliable. The project covers a broad capability surface, including infrastructure automation, container-based service deployment, and declarative configuration management. These tools assist users in maintaining reproducible server environments and managing complex service dependencies across private hardware. The directory is maintained as a version-controlled repository, ensuring that all updates and community-driven changes are tracked and transparent. - [machinelearningmindset/machine-learning-course](https://awesome-repositories.com/repository/machinelearningmindset-machine-learning-course.md) (0 ⭐) — ################################################### A Machine Learning Course with Python ################################################### - [crossoverjie/jcsprout](https://awesome-repositories.com/repository/crossoverjie-jcsprout.md) (26,901 ⭐) — JCSprout is a technical knowledge repository that provides a collection of structured guides and deep-dive articles focused on core backend engineering principles. It serves as a comprehensive resource for mastering advanced programming concepts, offering curated materials that combine detailed explanations with practical insights to support professional skill development and technical interview preparation. The project distinguishes itself through a modular knowledge base that covers Java concurrency, JVM internals, database architecture, and distributed system development. It provides specific technical tutorials on topics such as synchronization primitives, memory management, garbage collection, and network communication protocols, while also documenting real-world performance optimization strategies and production troubleshooting experiences. The content is organized into decoupled domains that link related concepts across different technical areas, facilitating systematic exploration of complex subjects. The repository utilizes a markdown-based structure that is processed into a navigable web interface to ensure clear presentation of its educational materials. - [karanpratapsingh/system-design](https://awesome-repositories.com/repository/karanpratapsingh-system-design.md) (44,051 ⭐) — This project is a comprehensive educational resource focused on the principles, patterns, and trade-offs required to design scalable, reliable, and high-performance distributed systems. It provides a structured curriculum that covers the fundamental architectural strategies necessary for building modern software infrastructure, ranging from high-level system decomposition to low-level networking and data management. The repository distinguishes itself by offering deep dives into complex architectural patterns, such as microservices-based decomposition, event-driven communication, and command-query responsibility segregation. It provides detailed comparisons of API design techniques, including REST, GraphQL, and gRPC, while offering guidance on when to utilize specific patterns like the backend-for-frontend approach or circuit breakers to manage service failures and maintain system stability. Beyond core architecture, the project explores a broad capability surface including infrastructure planning, database sharding, caching strategies, and security standards like OAuth and OpenID Connect. It also addresses operational reliability through service discovery, rate limiting, and disaster recovery planning, providing a technical reference library designed to assist engineers in navigating complex design discussions and technical interviews. - [gokumohandas/made-with-ml](https://awesome-repositories.com/repository/gokumohandas-made-with-ml.md) (48,343 ⭐) — Made-With-ML is an automated documentation generator and developer experience platform designed to transform source code into structured, searchable reference websites. It functions as a codebase intelligence tool that parses implementation details to provide clear explanations of logic and data requirements. The system distinguishes itself by leveraging language-level type annotations and structured code comments to generate interface specifications. By utilizing static analysis to extract metadata, it automates the transformation of docstrings into web-ready documentation, ensuring that technical references remain synchronized with the underlying codebase. The platform encompasses a complete pipeline for documentation management, including static site generation and automated deployment to web hosting services. This workflow enables teams to maintain accurate, accessible project knowledge bases that reflect current software specifications and function interfaces. - [enggen/deepmind-advanced-deep-learning-and-reinforcement-learning](https://awesome-repositories.com/repository/enggen-deepmind-advanced-deep-learning-and-reinforcement-learning.md) (862 ⭐) — Advanced Deep Learning and Reinforcement Learning course taught at UCL in partnership with Deepmind - [yudaocode/springboot-labs](https://awesome-repositories.com/repository/yudaocode-springboot-labs.md) (20,095 ⭐) — SpringBoot-Labs is a collection of educational resources and reference implementations for Java backend architecture and distributed systems. It provides practical lab guides and code samples focused on building applications with the Spring Boot framework and designing scalable microservices architectures. The project specifically covers service governance and distributed cloud deployment patterns using Spring Cloud and Spring Cloud Alibaba. It includes a dedicated kit for microservices and a guide for executing remote procedure calls and managing service discovery via the Dubbo protocol. The repository spans several capability areas, including data management for relational and NoSQL stores, distributed transaction coordination, and asynchronous messaging. It also covers observability through distributed tracing and centralized logging, as well as traffic management via API gateways and circuit breakers for system stability. The project is structured as a series of architecture labs and tutorials to demonstrate the implementation of these distributed system patterns. - [dapr/dapr](https://awesome-repositories.com/repository/dapr-dapr.md) (25,510 ⭐) — Dapr is a distributed application runtime that provides a sidecar-based infrastructure layer for building resilient microservices and event-driven applications. By utilizing a sidecar proxy pattern, it abstracts complex infrastructure tasks into standardized, network-accessible APIs, allowing developers to focus on application logic while the runtime handles service discovery, state management, and secure communication. The platform distinguishes itself through a pluggable component architecture and language-agnostic design, enabling services written in any programming language to interact with infrastructure building blocks via standard HTTP or gRPC protocols. It provides specialized support for stateful workflow orchestration and agentic AI development, ensuring that long-running processes and intelligent agents maintain state and reliability across service restarts. Furthermore, it enforces security through automatic mutual TLS authentication for all network traffic. Beyond its core orchestration capabilities, the runtime offers comprehensive observability features, including automated distributed tracing, system metrics collection, and log management. These tools provide visibility into complex service architectures without requiring manual instrumentation of the primary application code. The project includes extensive documentation, language-specific software development kits, and interactive learning resources to assist in the development and operation of distributed systems. - [klemenjak/nilm-papers-with-code](https://awesome-repositories.com/repository/klemenjak-nilm-papers-with-code.md) (144 ⭐) — An archive for NILM papers with source code and other supplemental material - [milanm/devops-roadmap](https://awesome-repositories.com/repository/milanm-devops-roadmap.md) (18,752 ⭐) — DevOps-Roadmap is a comprehensive educational repository and knowledge base designed to guide technical professionals through the complexities of modern software engineering. It functions as a structured curriculum and reference library, covering the full spectrum of skills required to master system architecture, infrastructure management, and cloud operations. The project distinguishes itself by bridging the gap between high-level architectural design and the practical realities of engineering leadership. It provides curated insights into distributed systems, data consistency, and scalable design patterns, while simultaneously offering frameworks for managing high-performing teams, navigating corporate dynamics, and fostering psychological safety within technical organizations. Beyond core architecture, the repository encompasses a broad capability surface that includes professional development, productivity optimization, and the integration of emerging technologies. It offers guidance on implementing AI-driven workflows, managing large-scale machine learning lifecycles, and applying evidence-based metrics to track team performance and development health. The repository serves as a centralized resource for engineers at all career stages, providing access to industry-standard principles, technical interview preparation materials, and strategic coaching frameworks. - [terryum/awesome-deep-learning-papers](https://awesome-repositories.com/repository/terryum-awesome-deep-learning-papers.md) (26,151 ⭐) — The most cited deep learning papers - [floodsung/llm-with-rl-papers](https://awesome-repositories.com/repository/floodsung-llm-with-rl-papers.md) (280 ⭐) — A collection of LLM with RL papers - [dwmkerr/hacker-laws](https://awesome-repositories.com/repository/dwmkerr-hacker-laws.md) (27,171 ⭐) — This project is a comprehensive, community-curated compendium of the fundamental principles, heuristics, and adages that define professional software engineering. It serves as a structured reference for developers and managers, documenting the empirical observations and mathematical formulas that shape system architecture, team dynamics, and technical decision-making. The repository distinguishes itself through a decentralized, open-contribution model that relies on distributed version control to maintain its knowledge base. By utilizing a flat-file data structure and markdown-based content curation, the project eliminates the need for complex database management systems, allowing contributors to easily propose and refine entries. The content is rendered into a navigable web interface using static site generation, which includes cross-referenced indexing to help users explore the relationships between various technical concepts. The collection covers a broad spectrum of professional expertise, ranging from established design philosophies and code quality standards to organizational management strategies. It provides insights into common pitfalls and trade-offs encountered in complex technical environments, offering a centralized resource for those seeking to understand the underlying rules that govern software development and system behavior. - [encoredev/encore](https://awesome-repositories.com/repository/encoredev-encore.md) (12,049 ⭐) — Encore is a distributed systems framework designed to unify backend development, infrastructure provisioning, and observability. It functions as an infrastructure-as-code platform that allows developers to define cloud resources, databases, and messaging topics directly within their application code. By analyzing these declarations at compile-time, the system automatically manages the deployment of cloud resources and security policies, ensuring parity between local development and production environments. The platform distinguishes itself through its integrated development experience, which includes a local workspace that mirrors production infrastructure to facilitate testing and debugging. It provides automated AI-assisted development tools that leverage application metadata and runtime telemetry to aid in code generation and performance analysis. Furthermore, the framework enforces architectural standards and automates the creation of ephemeral, production-like environments for every pull request, streamlining the validation process before deployment. Beyond its core orchestration capabilities, the framework includes a comprehensive suite for building type-safe APIs and event-driven services. It handles the complexities of service communication, including automated client library generation, request validation, and distributed tracing instrumentation. The system also incorporates robust security primitives, such as identity token validation, secret management, and automated traffic control, to support the development of secure, scalable backend architectures. - [jiachengcheng96/learning-with-bounded-instance-and-label-dependent-label-noise](https://awesome-repositories.com/repository/jiachengcheng96-learning-with-bounded-instance-and-label-dependent-label-noise.md) (5 ⭐) — This is a MATLAB demonstration of the Algorithm 1 in the paper Learning with Bounded Instance and Label-dependent Label Noise . The main program is eval_algo1.m. - [yeasy/blockchain_guide](https://awesome-repositories.com/repository/yeasy-blockchain-guide.md) (7,069 ⭐) — This is an educational resource that provides a comprehensive guide to blockchain and distributed ledger technologies, covering everything from fundamental concepts to practical deployment. The guide systematically explains the core architecture of blockchain systems, including consensus-based distributed ledgers, cryptographic hash chains, Merkle trees, and smart contract execution engines, while also detailing permissioned channel architectures and modular service platforms for enterprise use. The resource distinguishes itself by offering a dual-track learning path that serves both non-technical readers and developers, with hands-on coverage of major blockchain platforms including Bitcoin, Ethereum, and Hyperledger Fabric. It provides practical instruction on deploying enterprise blockchain solutions, managing channels and chaincode, and designing high-availability systems, while also exploring emerging areas such as AI and Web3 integration, cross-chain interoperability, and decentralized finance. Beyond blockchain fundamentals, the guide extends into related domains including cryptography and security applications, distributed systems concepts, and container management with Docker. It covers smart contract development across multiple platforms, supply chain tracking, digital identity verification, and token-based governance for decentralized autonomous organizations. The documentation includes a glossary of terminology, answers to common questions, and curated recommendations for further reading, making it suitable as both a structured learning path and a reference work. - [aflplusplus/aflplusplus](https://awesome-repositories.com/repository/aflplusplus-aflplusplus.md) (6,605 ⭐) — AFL++ is a coverage-guided fuzzing framework that discovers crashes and hangs in software by mutating inputs while tracking which code paths are exercised. It functions as both a fuzzing engine and a campaign manager, supporting targets with or without source code through compile-time instrumentation, dynamic binary instrumentation, and emulation. The framework includes tools for crash triage and analysis, test case minimization, and campaign deployment across local or distributed environments. The framework distinguishes itself through its breadth of instrumentation backends, allowing users to fuzz binary-only targets via QEMU user-mode emulation, Frida runtime instrumentation, static binary rewriting, Unicorn emulation, or full-system emulation with KVM. For source-available programs, it inserts coverage-tracking code at compile time using LLVM or GCC plugins, with options for selective instrumentation, comparison-guided instrumentation, and LAF-INTEL byte-splitting. AFL++ also supports fuzzing Windows PE binaries through Wine and QEMU, shared libraries, network services, GUI programs, and structured data with custom mutators. Beyond core fuzzing, AFL++ provides utilities for seed collection and deduplication, corpus minimization, crash exploration, and stability measurement. It integrates with continuous integration pipelines for short, randomized runs and supports multi-core scaling with one main and multiple secondary instances, as well as multi-machine synchronization for distributed campaigns. The framework can activate sanitizers during compilation and offers persistent-mode harnesses for increased throughput. - [kelseyhightower/kubernetes-the-hard-way](https://awesome-repositories.com/repository/kelseyhightower-kubernetes-the-hard-way.md) (48,696 ⭐) — Kubernetes The Hard Way is an educational curriculum designed to teach the fundamental architecture and operational requirements of container orchestration platforms. It provides a structured, hands-on learning path that guides users through the manual bootstrapping of a multi-node cluster from scratch, intentionally avoiding automated installers to ensure a deep understanding of how individual control plane and worker node components interact. The project distinguishes itself by requiring the manual configuration of every layer of the infrastructure, including the generation of cryptographic identities for mutual authentication and the establishment of encrypted communication channels between distributed components. Participants gain practical experience in managing distributed key-value consensus, configuring network-overlay routing for pod communication, and handling the lifecycle of system services through manual configuration files. This guide covers the entire provisioning process, from setting up compute resources to implementing security protocols and managing binary-based service deployments. By building the system piece by piece, users develop the operational knowledge necessary to troubleshoot complex failures in production environments. The tutorial requires four virtual or physical machines and provides a comprehensive walkthrough of the steps needed to establish a functional cluster environment. - [greensock/gsap](https://awesome-repositories.com/repository/greensock-gsap.md) (23,877 ⭐) — GSAP is a comprehensive JavaScript animation library designed for orchestrating complex motion sequences and interactive user interfaces. It provides a robust property-interpolation engine that calculates intermediate values for CSS styles, attributes, and numeric properties, enabling smooth visual transitions across web elements. The framework is built on a core architecture that manages animation lifecycles, timeline-based sequence orchestration, and virtual property interception to ensure precise control over motion. The library distinguishes itself through a modular, plugin-based extensibility model that allows for specialized capabilities like physics-based movement, shape morphing, and scroll-linked state synchronization without increasing the core footprint. It offers advanced tools for linking animation progress directly to browser scroll positions, enabling features such as parallax effects, element pinning, and interactive scroll-based navigation. Furthermore, it includes scoped animation lifecycle management, which automatically handles cleanup and state reversion when components are unmounted or destroyed. Beyond its core animation primitives, the project provides a functional data transformation pipeline for complex logic, including clamping, mapping, and interpolating numeric values. It supports a wide range of motion effects, from vector graphics and typography manipulation to drag-and-drop interactions and layout transitions. The library integrates with modern component-based architectures to ensure animations are correctly initialized and managed within the application lifecycle. - [terryds/learning-music-production-with-strudel](https://awesome-repositories.com/repository/terryds-learning-music-production-with-strudel.md) (0 ⭐) — A free course that teaches music production directly in the browser using Strudel. Access the full course at: https://terryds.notion.site/Learning-Music-with-Strudel-2ac98431b24180deb890cc7de667ea92?pvs=74 - [eleutherai/gpt-neo](https://awesome-repositories.com/repository/eleutherai-gpt-neo.md) (8,275 ⭐) — GPT-Neo is an open-source distributed training framework designed for scaling GPT-2 and GPT-3-style language models across multiple devices using mesh-tensorflow for model parallelism. It provides the infrastructure to train transformer-based language models with billions of parameters across distributed computing environments, making large-scale language model research accessible outside of proprietary systems. The framework supports training both autoregressive GPT-style models and masked language models like BERT or RoBERTa, with configurable masking strategies and token handling. It includes capabilities for fine-tuning models through reinforcement learning from human feedback, enabling alignment of model outputs with human preferences. For evaluation, GPT-Neo provides standardized benchmarking tools with contamination detection to ensure reproducible and transparent assessment of language model performance. Beyond training and evaluation, the project encompasses interpretability research tools for analyzing internal representations across transformer layers, including techniques for behavior attribution, concept erasure, and latent knowledge elicitation. It also supports multimodal data processing to extend language model research into image and audio domains. The framework implements memory-efficient training techniques such as gradient checkpointing, mixed-precision arithmetic, and dynamic batching to maximize hardware utilization during large-scale training runs. - [buraksezer/consistent](https://awesome-repositories.com/repository/buraksezer-consistent.md) (774 ⭐) — Consistent is a Go library that implements consistent hashing with bounded loads to distribute data keys across nodes in a distributed system. It provides a mechanism for mapping keys to cluster members that minimizes data movement during membership changes while preventing performance hotspots. The library distinguishes itself by enforcing strict capacity limits on individual nodes, ensuring that no single member becomes overwhelmed by excessive key assignments. It supports virtual node mapping to distribute physical capacity across the hash ring, allowing for granular control over load balancing and resource utilization. The project covers a broad range of distributed system requirements, including the ability to inject custom hashing algorithms to optimize data locality. It also facilitates high availability by identifying multiple candidate nodes for each key, enabling reliable data replication and redundancy across the cluster. - [jeffreyksmithjr/reactive-machine-learning-systems](https://awesome-repositories.com/repository/jeffreyksmithjr-reactive-machine-learning-systems.md) (0 ⭐) — Code from the book Machine Learning Systems. - [docker/distribution](https://awesome-repositories.com/repository/docker-distribution.md) (10,474 ⭐) — This project is a container image registry and server-side storage system designed to house container images, layers, and manifests. It functions as an OCI compliant registry server that adheres to the Open Container Initiative Distribution Specification to store and deliver content over HTTP. The system provides a self-hosted solution for managing private libraries of container images within professional-grade infrastructure. It is designed to enable the development of custom registries by extending a base toolkit with specialized libraries and business logic. The registry covers image distribution and hosting, utilizing a standardized API to serve container content to clients. It manages the storage and delivery of images and manifests to support streamlined application deployment. - [developer-y/cs-video-courses](https://awesome-repositories.com/repository/developer-y-cs-video-courses.md) (81,816 ⭐) — This project is a community-driven educational repository that serves as a comprehensive directory of university-level computer science video lectures. It provides a structured learning path for students and professionals, aggregating high-quality academic resources to facilitate self-paced study across a wide range of technical disciplines. The repository distinguishes itself through a collaborative maintenance model, utilizing version control workflows to allow contributors to expand and update the collection. Content is organized within a single, version-controlled document that leverages internal navigation anchors to create a hierarchical table of contents, ensuring that users can easily locate specific subject matter within the extensive index. The collection covers a broad spectrum of technical knowledge, spanning foundational topics like mathematics and data structures to specialized domains such as machine learning, distributed systems, and quantum computing. By curating expert-led instructional materials, the project functions as a centralized knowledge base for those seeking to master complex computing concepts independently. The information is presented through a platform-native rendering engine that converts repository markup files into accessible, human-readable web pages. - [vonng/ddia](https://awesome-repositories.com/repository/vonng-ddia.md) (22,648 ⭐) — This project serves as a comprehensive technical reference for the architecture and design of data-intensive applications. It provides a structured analysis of the fundamental principles required to build reliable, scalable, and maintainable software systems, covering the core trade-offs inherent in modern data infrastructure. The repository explores the mechanics of distributed data management, including strategies for replication, partitioning, and achieving consensus across multiple nodes. It details the design of storage engines, indexing techniques, and transaction management models, while also examining the architectural patterns for both batch and stream processing pipelines. Beyond foundational theory, the project covers the implementation of event-driven systems, including event sourcing, log-structured storage, and message brokering. It addresses the complexities of maintaining system consistency, enforcing transactional integrity, and managing derived data views in environments prone to network failures and concurrency challenges. The documentation is available in multiple formats, including an exportable digital book version, to support study and reference across various devices. - [real-logic/aeron](https://awesome-repositories.com/repository/real-logic-aeron.md) (8,688 ⭐) — Aeron provides infrastructure components for high-speed inter-process and network communication, archiving message streams, and coordinating replicated services. It functions as a system for moving data between remote applications or local processes with low latency and high throughput. The project distinguishes itself through a combination of shared memory for ultra-low latency inter-process communication and a reliable UDP messaging transport that supports both unicast and multicast. It further includes a consensus-based service orchestrator to maintain consistency across replicated state machines and a persistent message recording archive for capturing and replaying data streams. The system covers high-performance message transport, distributed consensus coordination, and persistent stream archiving. These capabilities enable fault-tolerant service coordination and reliable data delivery over datagram networks. - [floodsung/deep-learning-papers-reading-roadmap](https://awesome-repositories.com/repository/floodsung-deep-learning-papers-reading-roadmap.md) (39,527 ⭐) — Deep Learning papers reading roadmap for anyone who are eager to learn this amazing tech! - [hashicorp/raft](https://awesome-repositories.com/repository/hashicorp-raft.md) (9,037 ⭐) — This is a Raft consensus library and distributed consensus engine implemented in Go. It provides the primitives necessary to build fault-tolerant distributed services by implementing a replicated state machine that ensures a group of servers agree on a shared system state through leader election and log replication. The project distinguishes itself through a pluggable architecture for storage backends and snapshot storage, decoupling the consensus logic from physical persistence. It includes specialized mechanisms for leadership transfer, protocol version management to support rolling upgrades, and a dedicated heartbeat processing handler to prevent disk latency from interfering with failure detection. The library covers a broad range of distributed system capabilities, including quorum-based consensus, automated state checkpointing, and log compaction via snapshots. It also provides comprehensive observability through cluster health monitoring and performance metrics, as well as testing utilities for simulating network partitions and verifying consensus correctness. - [ipfs/ipfs](https://awesome-repositories.com/repository/ipfs-ipfs.md) (23,137 ⭐) — IPFS is a peer-to-peer hypermedia protocol and content-addressed storage system that identifies data by cryptographic hashes rather than network locations. It enables the creation of a decentralized web by organizing files and directories as directed acyclic graphs of linked content identifiers. The project differentiates itself through the use of a distributed hash table for locating peers and a system of signed records to map human-readable names to changing content. It also provides HTTP gateways that translate standard web requests into peer-to-peer queries, allowing decentralized data to be accessible via standard web browsers. Broad capabilities cover decentralized data storage, including content pinning for persistence and the hosting of static websites with custom DNS resolution. The system also includes peer-to-peer messaging via a topic-based pubsub system, cryptographic key management for data authenticity, and tools for visualizing network traffic and peer connectivity. Node operations can be managed through a command-line interface, a browser-based GUI, or a standardized HTTP RPC API. - [sciruby/distribution](https://awesome-repositories.com/repository/sciruby-distribution.md) (51 ⭐) — Probability distributions for Ruby. - [adrianhajdin/project_3d_developer_portfolio](https://awesome-repositories.com/repository/adrianhajdin-project-3d-developer-portfolio.md) (7,078 ⭐) — This project is a three-dimensional developer portfolio template and web application. It uses Three.js to render interactive 3D models, animations, and environmental effects directly within the browser to create an immersive professional showcase. The application integrates artificial intelligence to provide automated responses to visitor inquiries and includes a community forum where authenticated users can share knowledge. It also features a system for generating personalized learning roadmaps based on user profile data and an algorithmic content recommendation system to improve post discoverability. The technical surface covers full-stack capabilities, including token-based user authentication, global data synchronization with a remote database, and responsive layout management for different device sizes. It employs a component-based UI architecture with asynchronous API integrations for email services and AI content. - [nodesource/distributions](https://awesome-repositories.com/repository/nodesource-distributions.md) (13,834 ⭐) — This project is a Node.js binary distribution repository and Linux package repository. It provides a hosted set of pre-compiled JavaScript runtime binaries for various Linux distributions to simplify installation and version management through native package managers. The project includes a Node.js observability toolset and security policy manager. These components enable the gathering of runtime telemetry to monitor application health and performance via diagnostic dashboards, while providing a resource restriction layer that intercepts system calls to prevent unauthorized modules from accessing sensitive host resources. The capability surface covers binary installation for current and long-term support versions, runtime observability for identifying performance outliers, and security enforcement to restrict system resource access. - [google/magika](https://awesome-repositories.com/repository/google-magika.md) (17,139 ⭐) — Magika is an AI content type classifier and MIME type prediction engine that uses deep learning to identify file formats based on binary data. It analyzes byte sequences through a neural network to predict the content type of a file and provide associated confidence scores. The system features a foreign function interface that allows the core detection logic to be integrated across different programming languages. It includes a mechanism for configuring detection sensitivity and per-type thresholds to balance precision and recall. The project provides capabilities for bulk file analysis via recursive directory scanning and security content inspection. It supports the loading of model assets from local paths or remote URLs and includes a utility to list all supported content type labels. - [dask/distributed](https://awesome-repositories.com/repository/dask-distributed.md) (1,671 ⭐) — A distributed task scheduler for Dask - [z4ir3/finance-courses](https://awesome-repositories.com/repository/z4ir3-finance-courses.md) (0 ⭐) — Notes and examples of the financial courses from the EDHEC Business School on portfolio construction with python on Coursera. The courses are part of the Investment Management with Python and Machine Learning Specialization:… - [apachecn/interview](https://awesome-repositories.com/repository/apachecn-interview.md) (8,944 ⭐) — This project is a comprehensive knowledge base and study resource designed for mastering technical interviews. It provides structured guides, roadmaps, and curricula focused on data structures, algorithms, system design, and frontend engineering to help candidates prepare for software engineering screenings. The repository distinguishes itself by offering a holistic approach to professional advancement. Beyond technical drills, it includes a career development handbook covering resume optimization, salary benchmarking, and strategic negotiation coaching. It also provides detailed methodologies for cognitive learning, such as spaced repetition, the Feynman technique, and information structure mapping using MECE models. The technical surface covers a wide range of computer science and engineering domains. It includes deep dives into distributed systems architecture, machine learning workflows, and frontend component design. Practical application is supported through algorithmic problem sets, JavaScript implementation exercises, and system design blueprints for scalable web applications. The project is primarily implemented as a collection of Jupyter Notebooks. - [greydgl/pentestgpt](https://awesome-repositories.com/repository/greydgl-pentestgpt.md) (11,697 ⭐) — PentestGPT is an autonomous security testing framework that leverages large language models to plan, execute, and coordinate end-to-end penetration testing engagements. By functioning as an autonomous agent, the system automates the entire testing lifecycle, from initial reconnaissance and vulnerability analysis to the generation of custom exploits and the execution of post-exploitation tasks. The platform distinguishes itself through a multi-agent orchestration system that coordinates specialized AI agents to collaborate on complex, multi-stage attack chains. It integrates multimodal context, synthesizing both visual and textual data to inform its decision-making process. To ensure consistency and continuity, the framework maintains persistent session state, allowing users to pause and resume assessments without losing critical context or progress. The system provides a comprehensive suite of capabilities for managing external security utilities, including the ability to parse raw command-line output into structured data for automated analysis. It operates within isolated, containerized environments to ensure that testing workflows remain reproducible and secure across diverse target architectures. - [jvandevelde/distributed-playground](https://awesome-repositories.com/repository/jvandevelde-distributed-playground.md) (42 ⭐) — Distributed service playground with Vagrant, Consul, Docker & ASP.NET Core - [huggingface/agents-course](https://awesome-repositories.com/repository/huggingface-agents-course.md) (29,397 ⭐) — This project is a comprehensive educational curriculum focused on the design, implementation, and deployment of autonomous software agents. It provides a structured learning path that combines theoretical foundations with practical, hands-on exercises, enabling students to master the development of intelligent agents using industry-standard frameworks. The course distinguishes itself through an interactive, notebook-based delivery model that allows learners to execute code and experiment with agent frameworks directly. It supports flexible execution environments, allowing students to utilize either cloud-hosted containerized spaces or local model inference to accommodate varying hardware constraints. The curriculum is organized into modular, sequential units designed for incremental skill building, with an optional certification process available for those who complete the assignments. Beyond the core instructional material, the platform fosters a collaborative learning environment by integrating with community-driven support channels. The repository is maintained through version-controlled content, encouraging community contributions and peer-to-peer assistance to facilitate knowledge sharing throughout the learning journey. The course materials are hosted as a public repository, providing open access to all documentation, syllabus information, and interactive notebooks. - [jwasham/coding-interview-university](https://awesome-repositories.com/repository/jwasham-coding-interview-university.md) (353,639 ⭐) — This project is a comprehensive educational roadmap designed to guide software engineers through the mastery of computer science fundamentals and technical interview preparation. It provides a structured, dependency-aware learning path that organizes complex computing concepts into a hierarchical curriculum, enabling users to build a professional engineering foundation through iterative study and practical implementation. The curriculum distinguishes itself by integrating theoretical knowledge with professional development, offering a unified index of cross-referenced resources including books, academic papers, and video tutorials. It emphasizes the standardization of algorithmic efficiency through asymptotic complexity analysis and provides granular, modular topic decomposition to facilitate focused, incremental learning across vast technical domains. Beyond core algorithms and data structures, the repository covers a broad capability surface including system architecture design, distributed systems, computer security, and advanced mathematical modeling. It also provides strategic guidance for the entire hiring lifecycle, from resume optimization and behavioral interview preparation to long-term career growth. The entire knowledge base is maintained as a version-controlled, markdown-driven repository, allowing for a platform-agnostic and collaborative approach to technical education. - [d2l-ai/d2l-en](https://awesome-repositories.com/repository/d2l-ai-d2l-en.md) (29,001 ⭐) — This project is an educational platform and research toolkit designed to teach deep learning through a combination of mathematical theory, visual diagrams, and executable code. It provides a comprehensive environment for building, training, and evaluating neural networks, grounding complex concepts in interactive computational notebooks that allow for hands-on experimentation. The framework distinguishes itself by interleaving theoretical foundations—including linear algebra, calculus, and probability—with practical implementations across multiple industry-standard libraries. It supports flexible model development through modular layer composition, deferred parameter initialization, and symbolic graph hybridization, which balances the ease of imperative coding with the performance benefits of compiled execution. The project covers a broad capability surface, including computer vision, natural language processing, recommender systems, and reinforcement learning. It provides infrastructure for data pipeline management, gradient-based optimization, and distributed training across multiple hardware accelerators. Users can leverage built-in utilities for hyperparameter tuning, model regularization, and performance monitoring to diagnose and refine their architectures. The documentation is delivered as a series of interactive notebooks that can be executed locally or on remote cloud infrastructure, providing a standardized interface for deep learning research and experimentation.