awesome-repositories.com
Blog
MCP
awesome-repositories.com

Découvrez les meilleurs dépôts open-source grâce à notre recherche par IA.

ExplorerRecherches sélectionnéesAlternatives open sourceLogiciels auto-hébergésBlogPlan du site
ProjetServeur MCPÀ proposNotre méthodologiePresse
Mentions légalesConfidentialitéConditions d'utilisation
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·

443 dépôts

Awesome GitHub RepositoriesDistributed Computing

Systems and frameworks that enable computational tasks to be executed across multiple networked machines.

Explore 443 awesome GitHub repositories matching networking & communication · Distributed Computing. Refine with filters or upvote what's useful.

Awesome Distributed Computing GitHub Repositories

Trouvez les meilleurs dépôts grâce à l'IA.Nous recherchons les dépôts les plus pertinents grâce à l'IA.
  • donnemartin/system-design-primerAvatar de donnemartin

    donnemartin/system-design-primer

    353,387Voir sur GitHub↗

    Ce projet est une ressource éducative et un guide d'étude complet axé sur l'architecture des systèmes distribués et la conception d'infrastructures backend. Il fournit un programme structuré pour maîtriser les principes de scalabilité, de fiabilité et de performance requis pour concevoir des systèmes logiciels complexes. Le dépôt se distingue en offrant une approche méthodique de la préparation aux entretiens techniques, intégrant des modèles de conception, des compromis architecturaux et des outils de répétition espacée pour aider les utilisateurs à retenir des concepts complexes. Il met l'accent sur l'analyse axée sur les contraintes, enseignant aux utilisateurs comment évaluer des exigences concurrentes comme la latence, la cohérence et la disponibilité lors de l'élaboration de conceptions architecturales. Le contenu couvre un large spectre de capacités de conception de systèmes, notamment des stratégies pour la mise à l'échelle des bases de données, la gestion du trafic et l'optimisation de l'infrastructure. Il détaille des techniques pour la mise à l'échelle horizontale, la mise en cache multicouche, la communication asynchrone et la découverte de services, tout en fournissant des cadres pour effectuer des estimations de ressources et la planification de la capacité. La documentation est organisée comme un guide d'étude, offrant un chemin systématique à travers les fondamentaux de l'ingénierie backend et de la conception de systèmes à grande échelle.

    Facilitates reliable data transfer between internal components using remote procedure call frameworks.

    Pythondesigndesign-patternsdesign-system
    Voir sur GitHub↗353,387
  • vinta/awesome-pythonAvatar de vinta

    vinta/awesome-python

    303,207Voir sur GitHub↗

    Ce projet est un répertoire complet, organisé par la communauté, qui structure un vaste paysage de bibliothèques, frameworks et outils logiciels Python. Il sert de base de connaissances centralisée conçue pour faciliter la navigation dans l'écosystème et accélérer la découverte par les développeurs tout au long du cycle de vie du développement logiciel. Le répertoire se distingue en fournissant un index structuré de ressources classées par domaine technique, allant des utilitaires de développement fondamentaux aux domaines d'ingénierie spécialisés. Il couvre des capacités de haut niveau, notamment l'intelligence artificielle, la science des données, le développement web et la gestion d'infrastructure, permettant aux développeurs d'identifier des solutions éprouvées pour des défis techniques spécifiques. Le projet englobe une large surface de capacités, notamment des outils pour la gestion des dépendances, l'analyse de code statique et les tests automatisés. Il catalogue également des ressources pour le stockage de données persistantes, l'orchestration d'infrastructure cloud et le développement d'interfaces, fournissant une référence unifiée pour la construction et la maintenance de systèmes logiciels complexes.

    Maintains persistent, real-time bidirectional data streams between client applications and backend servers.

    Pythonawesomecollectionspython
    Voir sur GitHub↗303,207
  • awesome-selfhosted/awesome-selfhostedAvatar de awesome-selfhosted

    awesome-selfhosted/awesome-selfhosted

    299,516Voir sur GitHub↗

    Ce projet est un répertoire de logiciels open source organisé par la communauté, conçu pour être déployé dans des environnements de serveurs privés et des laboratoires domestiques. Il sert de ressource complète pour découvrir des alternatives indépendantes et auto-hébergées aux services cloud grand public, permettant aux utilisateurs de conserver la pleine propriété des données et le contrôle de leur infrastructure numérique. Le répertoire est structuré par une taxonomie hiérarchique qui organise une vaste collection d'applications en catégories logiques, allant de la gestion multimédia et de l'analyse de données à la communication privée et aux outils de productivité d'équipe. Il se distingue par un processus de revue par les pairs collaboratif, où les membres de la communauté valident la qualité et la pertinence de chaque soumission pour garantir que le répertoire reste précis et fiable. Le projet couvre une large surface de capacités, notamment l'automatisation de l'infrastructure, le déploiement de services basés sur des conteneurs et la gestion de configuration déclarative. Ces outils aident les utilisateurs à maintenir des environnements de serveur reproductibles et à gérer des dépendances de services complexes sur du matériel privé. Le répertoire est maintenu en tant que dépôt contrôlé par version, garantissant que toutes les mises à jour et les changements pilotés par la communauté sont suivis et transparents.

    Hosts decentralized, real-time instant messaging servers based on the open XMPP protocol.

    awesomeawesome-listcloud
    Voir sur GitHub↗299,516
  • tensorflow/tensorflowAvatar de tensorflow

    tensorflow/tensorflow

    195,697Voir sur GitHub↗

    TensorFlow is a comprehensive machine learning framework designed for the construction, training, and deployment of complex mathematical models. It utilizes a graph-based execution model that represents operations as directed acyclic graphs, enabling automatic differentiation and efficient parallel processing. The system provides high-level interfaces for defining neural network architectures, alongside a robust engine for managing multidimensional array structures and tensor mathematics. The framework distinguishes itself through a scalable distributed runtime that orchestrates workloads acr

    Orchestrates parallelized training and inference workloads across decentralized network nodes and heterogeneous hardware accelerators.

    C++deep-learningdeep-neural-networksdistributed
    Voir sur GitHub↗195,697
  • n8n-io/n8nAvatar de n8n-io

    n8n-io/n8n

    192,772Voir sur GitHub↗

    n8n is a workflow automation platform that combines a visual interface with code-based extensibility to design, orchestrate, and manage automated processes. It provides a comprehensive suite of tools for data transformation, filtering, and storage, allowing users to build complex logic through conditional branching, looping, and sub-workflow execution. The platform supports both pre-built integration nodes and custom code execution in JavaScript or Python, enabling connectivity with a wide range of external services and APIs. The platform includes a suite of generative AI capabilities, such a

    Exposes a comprehensive HTTP interface for programmatic control over workflows and external system integrations.

    TypeScriptaiapisautomation
    Voir sur GitHub↗192,772
  • avelino/awesome-goAvatar de avelino

    avelino/awesome-go

    175,576Voir sur GitHub↗

    This project serves as a comprehensive language ecosystem index, functioning as a centralized, community-curated directory for the Go programming language. It organizes a vast landscape of software components, libraries, and development tools into a structured, navigable hierarchy, enabling developers to efficiently discover resources tailored to specific functional domains. The repository distinguishes itself through a decentralized contribution model, where community-driven updates ensure the index remains current with the rapidly evolving software landscape. Beyond simple resource listing,

    Supports building fault-tolerant, deterministic state machine replication engines for distributed systems.

    Goawesomeawesome-listgo
    Voir sur GitHub↗175,576
  • snailclimb/javaguideAvatar de Snailclimb

    Snailclimb/JavaGuide

    156,541Voir sur GitHub↗

    This project is a comprehensive educational repository providing technical documentation and learning materials across a wide range of computer science and software engineering domains. It serves as a centralized knowledge base for developers, covering core programming concepts, database management, distributed systems, and system design principles. The content spans fundamental Java programming, including collection frameworks and runtime environments, alongside deep dives into web communication protocols and browser internals. It also provides extensive resources on database internals, such

    Explains how distributed nodes maintain state synchronization and reach agreement using established consensus protocols.

    JavaScriptalgorithmsdistributed-systemsinterview
    Voir sur GitHub↗156,541
  • genymobile/scrcpyAvatar de Genymobile

    Genymobile/scrcpy

    143,637Voir sur GitHub↗

    This project provides a desktop-based interface for remote control and screen mirroring of Android devices. It functions by establishing a persistent, multiplexed communication channel over the Android Debug Bridge, allowing for the transmission of raw binary data streams between a host computer and a connected mobile device. The tool distinguishes itself by injecting a lightweight binary into the mobile runtime to access system-level APIs for direct screen buffer capture and input event injection. By translating desktop mouse and keyboard signals into native Linux kernel events, it enables r

    Creates a persistent, bidirectional communication channel over the Android Debug Bridge to transport raw binary data streams.

    Candroidcffmpeg
    Voir sur GitHub↗143,637
  • firecrawl/firecrawlAvatar de firecrawl

    firecrawl/firecrawl

    133,479Voir sur GitHub↗

    Firecrawl is a web data extraction platform designed to convert unstructured web content into clean, LLM-ready formats like markdown or JSON. It functions as an autonomous web crawler and scraper, capable of mapping entire domains, performing recursive navigation, and executing complex data gathering tasks. By leveraging headless browser orchestration, the system handles dynamic, JavaScript-heavy pages to ensure comprehensive data capture. The platform distinguishes itself through its focus on agentic workflows, providing a programmatic interface that allows autonomous agents to perform live

    Coordinates discovery tasks by partitioning and synchronizing web data collection across multiple worker nodes.

    TypeScriptaiai-agentsai-crawler
    Voir sur GitHub↗133,479
  • comfy-org/comfyuiAvatar de Comfy-Org

    Comfy-Org/ComfyUI

    117,227Voir sur GitHub↗

    ComfyUI is a node-based generative AI orchestration engine designed for constructing, testing, and executing complex image and video synthesis pipelines. By utilizing a directed acyclic graph execution model, the platform allows users to build reproducible workflows through modular, interconnected processing blocks without requiring manual code implementation. It serves as both a local environment for high-performance model inference and a production-ready server for deploying generative capabilities. The platform distinguishes itself through its focus on workflow portability and extensibilit

    Establishes real-time communication channels between the graphical interface and backend execution engine to stream live progress updates and node status.

    Pythonaicomfycomfyui
    Voir sur GitHub↗117,227
  • tauri-apps/tauriAvatar de tauri-apps

    tauri-apps/tauri

    107,946Voir sur GitHub↗

    Tauri is a cross-platform framework for building desktop applications that combine web-based user interfaces with a memory-safe systems-language backend. It functions as a secure runtime that hosts web content within native windowing containers, allowing developers to leverage existing web technologies while maintaining high-performance native logic. By compiling applications into small-footprint, platform-specific binaries, the framework avoids bundling heavy runtime environments, resulting in lightweight executables. The project distinguishes itself through a capability-based security model

    Coordinates bidirectional, asynchronous communication between web-based frontends and native backends using serialized message passing.

    Rustdesktop-apphigh-performancemobile-app
    Voir sur GitHub↗107,946
  • denoland/denoAvatar de denoland

    denoland/deno

    107,110Voir sur GitHub↗

    Deno is a high-performance runtime for JavaScript and TypeScript that prioritizes security and developer productivity. Built on the V8 engine, it provides a secure execution environment that enforces a default-deny security model, requiring explicit user authorization for access to system resources like the file system, network, and environment variables. The runtime natively supports modern web-standard APIs, ensuring consistent behavior and portability across different environments. What distinguishes Deno is its integrated approach to the software development lifecycle. It bundles essentia

    Upgrades standard HTTP requests into persistent, bidirectional channels for real-time data exchange.

    Rustdenojavascriptrust
    Voir sur GitHub↗107,110
  • pytorch/pytorchAvatar de pytorch

    pytorch/pytorch

    100,814Voir sur GitHub↗

    PyTorch is a machine learning framework centered on a GPU-ready tensor library that supports multi-dimensional array operations across both CPU and accelerator hardware. It provides a foundational infrastructure for mathematical computation and dynamic neural network construction, utilizing a tape-based automatic differentiation system that allows for flexible, non-static graph execution. The framework is designed for deep integration with Python, enabling natural usage alongside standard scientific computing ecosystems. It distinguishes itself through a comprehensive distributed training sui

    Partitions large models across multiple devices to bypass single-device memory constraints during parallel execution.

    Pythonautograddeep-learninggpu
    Voir sur GitHub↗100,814
  • oven-sh/bunAvatar de oven-sh

    oven-sh/bun

    93,257Voir sur GitHub↗

    Bun is a high-performance runtime environment designed to execute JavaScript and TypeScript applications with minimal latency and high throughput. Built on a native core implemented in Zig, it provides a unified execution engine that leverages JavaScriptCore for efficient memory management and low-latency startup. The project functions as an all-in-one toolchain, integrating a native bundler, transpiler, package manager, and test runner into a single command-line interface. What distinguishes Bun is its focus on native system integration and developer productivity. It features a high-performa

    Facilitates persistent, bidirectional communication channels for real-time data exchange through high-performance server-side primitives.

    Rustbunbundlerjavascript
    Voir sur GitHub↗93,257
  • openai/codexAvatar de openai

    openai/codex

    91,445Voir sur GitHub↗

    Codex is an automated programming tool and generative code assistant designed to interpret developer intent through a natural language interface. It functions as a machine learning model trained on public code repositories to provide intelligent code completion, suggestions, and refactoring within development environments. By translating human instructions into executable code snippets, the system bridges the gap between high-level technical requirements and functional software implementation. The engine utilizes transformer-based sequence modeling and supervised fine-tuning to align its outp

    Splits large neural network layers across multiple hardware accelerators to optimize memory usage for high-parameter models.

    Rust
    Voir sur GitHub↗91,445
  • bitcoin/bitcoinAvatar de bitcoin

    bitcoin/bitcoin

    89,442Voir sur GitHub↗

    This project is a cryptographic consensus engine and distributed ledger client that functions as a peer-to-peer network node. It enables decentralized network participation by allowing users to independently validate transactions and blocks, ensuring data integrity and consensus without reliance on a centralized authority. The software utilizes an unspent transaction output model to track ownership and verify state transitions across the network. What distinguishes this implementation is its commitment to verifiable security and deterministic operation. It features a reproducible build system

    Acts as a secure gateway for authenticated node management, transaction broadcasting, and data retrieval.

    C++bitcoinc-plus-pluscryptocurrency
    Voir sur GitHub↗89,442
  • louislam/uptime-kumaAvatar de louislam

    louislam/uptime-kuma

    88,107Voir sur GitHub↗

    Uptime Kuma is a self-hosted monitoring platform designed to track the availability and performance of network services and websites. It functions as a centralized dashboard that executes asynchronous health checks on a scheduled interval, providing real-time visibility into infrastructure health and service uptime. The platform distinguishes itself through a dedicated notification engine that dispatches alerts across multiple third-party messaging services, alongside a public status page generator that allows users to communicate service health and historical metrics via custom domains. Its

    Maintains persistent bidirectional connections to push live status updates to clients without requiring manual polling.

    JavaScriptdockermonitormonitoring
    Voir sur GitHub↗88,107
  • modelcontextprotocol/serversAvatar de modelcontextprotocol

    modelcontextprotocol/servers

    87,320Voir sur GitHub↗

    The Model Context Protocol is a standardized communication framework designed to connect language models to external data sources, functional tools, and interactive user interfaces. It provides a vendor-neutral interface layer that enables AI hosts to discover and execute capabilities across heterogeneous service environments, using a JSON-RPC based messaging standard to facilitate bidirectional communication between clients and servers. The protocol distinguishes itself through a robust capability-based handshake that negotiates feature sets during session initialization, ensuring compatibil

    Implements a JSON-RPC messaging standard to define bidirectional communication patterns for distributed service architectures.

    TypeScript
    Voir sur GitHub↗87,320
  • syncthing/syncthingAvatar de syncthing

    syncthing/syncthing

    85,400Voir sur GitHub↗

    Syncthing est un moteur de synchronisation de fichiers décentralisé qui maintient des états de données cohérents sur plusieurs appareils via un réseau maillé peer-to-peer. Il fonctionne comme un démon en arrière-plan qui réplique automatiquement les créations, modifications et suppressions de fichiers entre des nœuds de confiance sans nécessiter de serveurs centraux. En utilisant l'indexation de blocs adressables par contenu et la synchronisation delta au niveau des blocs, le système identifie et transfère uniquement les segments modifiés des fichiers, assurant une propagation efficace des données dans des environnements hétérogènes. Le projet se distingue par une architecture axée sur la sécurité qui repose sur l'authentification mutuelle TLS pour vérifier l'identité des appareils, garantissant que toutes les connexions sont liées cryptographiquement aux empreintes de certificats de confiance. Il prend en charge des modes de synchronisation flexibles, notamment la réplication bidirectionnelle, la mise en miroir unidirectionnelle pour les sauvegardes et l'application basée sur des références. Pour plus de confidentialité, le système fournit un chiffrement au niveau des dossiers pour les appareils non approuvés et permet un contrôle granulaire du trafic réseau, y compris la possibilité de restreindre les opérations aux réseaux locaux ou d'utiliser une infrastructure de relais pour le franchissement NAT. Au-delà de ses capacités de réplication de base, la plateforme offre des outils de gestion complets, notamment un tableau de bord web pour surveiller l'état de la connexion et le débit, ainsi qu'une interface de ligne de commande pour une configuration avancée. Il inclut des stratégies de versionnage robustes pour protéger contre la perte de données et prend en charge des scénarios de déploiement complexes grâce à une intégration native des services et des métriques d'observabilité. Le logiciel est conçu pour une compatibilité multiplateforme et peut être installé via des gestionnaires de paquets standard ou des environnements conteneurisés.

    Operates as a background service that automatically replicates file modifications across remote systems as soon as they come online.

    Gogop2ppeer-to-peer
    Voir sur GitHub↗85,400
  • localsend/localsendAvatar de localsend

    localsend/localsend

    83,448Voir sur GitHub↗

    LocalSend is a cross-platform utility designed for secure, peer-to-peer file transfers between devices on the same local network. By establishing direct, encrypted communication channels, the application enables users to share files without relying on external servers, cloud storage, or active internet connectivity. The project distinguishes itself through a unified codebase that supports native-looking interfaces across desktop and mobile operating systems. It utilizes automated peer discovery to identify available devices on a subnet and employs end-to-end encryption to ensure data integrit

    Protects data integrity and privacy through end-to-end encryption during direct peer-to-peer communication.

    Dartdartfile-sharingflutter
    Voir sur GitHub↗83,448
Préc.123456…23Suivant
  1. Home
  2. Networking & Communication
  3. Distributed Systems and Peer-to-Peer
  4. Distributed Computing

Explorer les sous-tags

  • Ability-Based Distributed ExecutorsRunning computations across remote nodes using an effect system that handles dependency deployment and execution without external frameworks. **Distinct from Distributed Computing:** Distinct from Distributed Computing: focuses on using an effect system for distributed execution, not general cluster computing frameworks.
  • Bytecode Shipping EnginesShip a function's bytecode tree to a remote location and sync missing dependencies on the fly, enabling distributed execution without pre-deployment setup. **Distinct from Distributed Computing:** Distinct from Distributed Computing: focuses on shipping bytecode and syncing dependencies on the fly, not general distributed task execution.
  • Communication Protocols8 sous-tagsStandards and mechanisms for inter-process communication.
  • Consensus and Coordination Systems4 sous-tagsAlgorithms and services for maintaining global state, agreement, and topology across distributed nodes.
  • Data Synchronization and Consistency8 sous-tagsFrameworks and protocols for managing data state, replication, and consistency models across distributed environments.
  • Data-Colocated ComputationExecuting computational logic on the specific nodes where the required data is stored to minimize network movement. **Distinct from Distributed Computing:** Distinct from general Distributed Computing: specifically refers to the 'data-locality' or colocation pattern where logic moves to data.
  • Deterministic ID Generation2 sous-tagsComputing unique identifiers based on parent IDs and keys rather than random generation. **Distinct from Distributed ID Generators:** Focuses on deterministic computation from seeds/parents rather than globally unique random IDs.
  • Distributed Crawl CoordinationMechanisms for partitioning and synchronizing web discovery tasks across multiple worker nodes.
  • Distributed Execution Runtimes2 sous-tagsInfrastructure layers for orchestrating general-purpose parallel tasks, batch jobs, and inference workloads.
  • Distributed ID Generators3 sous-tagsAlgorithms and services for creating globally unique IDs.
  • Hierarchical Metric Aggregation1 sous-tagParent-child node relationships for data forwarding and centralization.
  • Hierarchical ScalingArchitectures that use parent-child relationships to scale data collection and retention.
  • Model Parallelism Techniques5 sous-tagsMethods for partitioning neural network layers, tensors, or parameters across hardware to overcome memory and compute constraints.
  • Private Distributed ComputationDistributed execution of computations where the underlying data is kept private through encryption. **Distinct from Distributed Computing:** Distinct from Distributed Computing: specifies that the computation is performed privately/encrypted, not just across multiple machines.
  • Remote Procedure Call Frameworks3 sous-tagsFrameworks that facilitate remote execution of functions and inter-process communication across distributed system components.