awesome-repositories.com
博客
MCP
awesome-repositories.com

通过 AI 驱动的搜索,发现最优秀的开源仓库。

探索精选搜索开源替代品自托管软件博客网站地图
项目MCP 服务器关于排名机制媒体报道
法律隐私政策服务条款
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·

443 个仓库

Awesome GitHub RepositoriesDistributed Computing

Systems and frameworks that enable computational tasks to be executed across multiple networked machines.

Explore 443 awesome GitHub repositories matching networking & communication · Distributed Computing. Refine with filters or upvote what's useful.

Awesome Distributed Computing GitHub Repositories

用 AI 发现最棒的仓库。我们将通过 AI 为您搜索最匹配的仓库。
  • donnemartin/system-design-primerdonnemartin 的头像

    donnemartin/system-design-primer

    353,387在 GitHub 上查看↗

    这是一个关于分布式系统架构和后端基础设施设计的综合教育资源和学习指南。它为掌握设计复杂软件系统所需的扩展性、可靠性和性能原则提供了结构化课程。 该仓库通过提供一种系统化的技术面试准备方法脱颖而出,结合了设计模式、架构权衡和间隔重复工具,帮助用户记忆复杂概念。它强调约束驱动的分析,教授用户在起草架构设计时如何评估延迟、一致性和可用性等相互竞争的需求。 内容涵盖了广泛的系统设计能力,包括数据库扩展、流量管理和基础设施优化策略。它详细介绍了水平扩展、多层缓存、异步通信和服务发现技术,同时还提供了用于执行资源估算和容量规划的框架。 文档以学习指南的形式组织,为后端工程和大规模系统设计的基础知识提供了系统化的路径。

    Facilitates reliable data transfer between internal components using remote procedure call frameworks.

    Pythondesigndesign-patternsdesign-system
    在 GitHub 上查看↗353,387
  • vinta/awesome-pythonvinta 的头像

    vinta/awesome-python

    303,207在 GitHub 上查看↗

    这是一个全面的、由社区策划的目录,组织了庞大的 Python 软件库、框架和工具生态。它作为一个中心化知识库,旨在促进生态导航并加速开发者在整个软件开发生命周期中的发现过程。 该目录通过提供按技术领域分类的结构化资源索引脱颖而出,范围从基础开发工具到专业工程领域。它涵盖了人工智能、数据科学、Web 开发和基础设施管理等高级能力,使开发者能够为特定的技术挑战识别经过验证的解决方案。 该项目涵盖了广泛的能力领域,包括依赖管理、静态代码分析和自动化测试工具。它还编目了用于持久数据存储、云基础设施编排和接口开发的资源,为构建和维护复杂软件系统提供了统一的参考。

    Maintains persistent, real-time bidirectional data streams between client applications and backend servers.

    Pythonawesomecollectionspython
    在 GitHub 上查看↗303,207
  • awesome-selfhosted/awesome-selfhostedawesome-selfhosted 的头像

    awesome-selfhosted/awesome-selfhosted

    299,516在 GitHub 上查看↗

    这是一个由社区策划的开源软件目录,专为在私有服务器环境和家庭实验室中部署而设计。它作为发现主流云服务独立自托管替代方案的综合资源,使用户能够保持对数字基础设施的完全数据所有权和控制权。 该目录通过层级分类法构建,将庞大的应用程序集合组织成逻辑类别,范围从媒体管理和数据分析到私有通信和团队生产力工具。它通过协作同行评审流程脱颖而出,社区成员验证每个提交的质量和相关性,以确保目录保持准确和可靠。 该项目涵盖了广泛的能力领域,包括基础设施自动化、基于容器的服务部署和声明式配置管理。这些工具协助用户维护可复现的服务器环境,并管理私有硬件上的复杂服务依赖。 该目录作为版本控制仓库进行维护,确保所有更新和社区驱动的变更都是可追踪且透明的。

    Hosts decentralized, real-time instant messaging servers based on the open XMPP protocol.

    awesomeawesome-listcloud
    在 GitHub 上查看↗299,516
  • tensorflow/tensorflowtensorflow 的头像

    tensorflow/tensorflow

    195,697在 GitHub 上查看↗

    TensorFlow is a comprehensive machine learning framework designed for the construction, training, and deployment of complex mathematical models. It utilizes a graph-based execution model that represents operations as directed acyclic graphs, enabling automatic differentiation and efficient parallel processing. The system provides high-level interfaces for defining neural network architectures, alongside a robust engine for managing multidimensional array structures and tensor mathematics. The framework distinguishes itself through a scalable distributed runtime that orchestrates workloads acr

    Orchestrates parallelized training and inference workloads across decentralized network nodes and heterogeneous hardware accelerators.

    C++deep-learningdeep-neural-networksdistributed
    在 GitHub 上查看↗195,697
  • n8n-io/n8nn8n-io 的头像

    n8n-io/n8n

    192,772在 GitHub 上查看↗

    n8n is a workflow automation platform that combines a visual interface with code-based extensibility to design, orchestrate, and manage automated processes. It provides a comprehensive suite of tools for data transformation, filtering, and storage, allowing users to build complex logic through conditional branching, looping, and sub-workflow execution. The platform supports both pre-built integration nodes and custom code execution in JavaScript or Python, enabling connectivity with a wide range of external services and APIs. The platform includes a suite of generative AI capabilities, such a

    Exposes a comprehensive HTTP interface for programmatic control over workflows and external system integrations.

    TypeScriptaiapisautomation
    在 GitHub 上查看↗192,772
  • avelino/awesome-goavelino 的头像

    avelino/awesome-go

    175,576在 GitHub 上查看↗

    This project serves as a comprehensive language ecosystem index, functioning as a centralized, community-curated directory for the Go programming language. It organizes a vast landscape of software components, libraries, and development tools into a structured, navigable hierarchy, enabling developers to efficiently discover resources tailored to specific functional domains. The repository distinguishes itself through a decentralized contribution model, where community-driven updates ensure the index remains current with the rapidly evolving software landscape. Beyond simple resource listing,

    Supports building fault-tolerant, deterministic state machine replication engines for distributed systems.

    Goawesomeawesome-listgo
    在 GitHub 上查看↗175,576
  • snailclimb/javaguideSnailclimb 的头像

    Snailclimb/JavaGuide

    156,541在 GitHub 上查看↗

    This project is a comprehensive educational repository providing technical documentation and learning materials across a wide range of computer science and software engineering domains. It serves as a centralized knowledge base for developers, covering core programming concepts, database management, distributed systems, and system design principles. The content spans fundamental Java programming, including collection frameworks and runtime environments, alongside deep dives into web communication protocols and browser internals. It also provides extensive resources on database internals, such

    Explains how distributed nodes maintain state synchronization and reach agreement using established consensus protocols.

    JavaScriptalgorithmsdistributed-systemsinterview
    在 GitHub 上查看↗156,541
  • genymobile/scrcpyGenymobile 的头像

    Genymobile/scrcpy

    143,637在 GitHub 上查看↗

    This project provides a desktop-based interface for remote control and screen mirroring of Android devices. It functions by establishing a persistent, multiplexed communication channel over the Android Debug Bridge, allowing for the transmission of raw binary data streams between a host computer and a connected mobile device. The tool distinguishes itself by injecting a lightweight binary into the mobile runtime to access system-level APIs for direct screen buffer capture and input event injection. By translating desktop mouse and keyboard signals into native Linux kernel events, it enables r

    Creates a persistent, bidirectional communication channel over the Android Debug Bridge to transport raw binary data streams.

    Candroidcffmpeg
    在 GitHub 上查看↗143,637
  • firecrawl/firecrawlfirecrawl 的头像

    firecrawl/firecrawl

    133,479在 GitHub 上查看↗

    Firecrawl is a web data extraction platform designed to convert unstructured web content into clean, LLM-ready formats like markdown or JSON. It functions as an autonomous web crawler and scraper, capable of mapping entire domains, performing recursive navigation, and executing complex data gathering tasks. By leveraging headless browser orchestration, the system handles dynamic, JavaScript-heavy pages to ensure comprehensive data capture. The platform distinguishes itself through its focus on agentic workflows, providing a programmatic interface that allows autonomous agents to perform live

    Coordinates discovery tasks by partitioning and synchronizing web data collection across multiple worker nodes.

    TypeScriptaiai-agentsai-crawler
    在 GitHub 上查看↗133,479
  • comfy-org/comfyuiComfy-Org 的头像

    Comfy-Org/ComfyUI

    117,227在 GitHub 上查看↗

    ComfyUI is a node-based generative AI orchestration engine designed for constructing, testing, and executing complex image and video synthesis pipelines. By utilizing a directed acyclic graph execution model, the platform allows users to build reproducible workflows through modular, interconnected processing blocks without requiring manual code implementation. It serves as both a local environment for high-performance model inference and a production-ready server for deploying generative capabilities. The platform distinguishes itself through its focus on workflow portability and extensibilit

    Establishes real-time communication channels between the graphical interface and backend execution engine to stream live progress updates and node status.

    Pythonaicomfycomfyui
    在 GitHub 上查看↗117,227
  • tauri-apps/tauritauri-apps 的头像

    tauri-apps/tauri

    107,946在 GitHub 上查看↗

    Tauri is a cross-platform framework for building desktop applications that combine web-based user interfaces with a memory-safe systems-language backend. It functions as a secure runtime that hosts web content within native windowing containers, allowing developers to leverage existing web technologies while maintaining high-performance native logic. By compiling applications into small-footprint, platform-specific binaries, the framework avoids bundling heavy runtime environments, resulting in lightweight executables. The project distinguishes itself through a capability-based security model

    Coordinates bidirectional, asynchronous communication between web-based frontends and native backends using serialized message passing.

    Rustdesktop-apphigh-performancemobile-app
    在 GitHub 上查看↗107,946
  • denoland/denodenoland 的头像

    denoland/deno

    107,110在 GitHub 上查看↗

    Deno is a high-performance runtime for JavaScript and TypeScript that prioritizes security and developer productivity. Built on the V8 engine, it provides a secure execution environment that enforces a default-deny security model, requiring explicit user authorization for access to system resources like the file system, network, and environment variables. The runtime natively supports modern web-standard APIs, ensuring consistent behavior and portability across different environments. What distinguishes Deno is its integrated approach to the software development lifecycle. It bundles essentia

    Upgrades standard HTTP requests into persistent, bidirectional channels for real-time data exchange.

    Rustdenojavascriptrust
    在 GitHub 上查看↗107,110
  • pytorch/pytorchpytorch 的头像

    pytorch/pytorch

    100,814在 GitHub 上查看↗

    PyTorch is a machine learning framework centered on a GPU-ready tensor library that supports multi-dimensional array operations across both CPU and accelerator hardware. It provides a foundational infrastructure for mathematical computation and dynamic neural network construction, utilizing a tape-based automatic differentiation system that allows for flexible, non-static graph execution. The framework is designed for deep integration with Python, enabling natural usage alongside standard scientific computing ecosystems. It distinguishes itself through a comprehensive distributed training sui

    Partitions large models across multiple devices to bypass single-device memory constraints during parallel execution.

    Pythonautograddeep-learninggpu
    在 GitHub 上查看↗100,814
  • oven-sh/bunoven-sh 的头像

    oven-sh/bun

    93,257在 GitHub 上查看↗

    Bun is a high-performance runtime environment designed to execute JavaScript and TypeScript applications with minimal latency and high throughput. Built on a native core implemented in Zig, it provides a unified execution engine that leverages JavaScriptCore for efficient memory management and low-latency startup. The project functions as an all-in-one toolchain, integrating a native bundler, transpiler, package manager, and test runner into a single command-line interface. What distinguishes Bun is its focus on native system integration and developer productivity. It features a high-performa

    Facilitates persistent, bidirectional communication channels for real-time data exchange through high-performance server-side primitives.

    Rustbunbundlerjavascript
    在 GitHub 上查看↗93,257
  • openai/codexopenai 的头像

    openai/codex

    91,445在 GitHub 上查看↗

    Codex is an automated programming tool and generative code assistant designed to interpret developer intent through a natural language interface. It functions as a machine learning model trained on public code repositories to provide intelligent code completion, suggestions, and refactoring within development environments. By translating human instructions into executable code snippets, the system bridges the gap between high-level technical requirements and functional software implementation. The engine utilizes transformer-based sequence modeling and supervised fine-tuning to align its outp

    Splits large neural network layers across multiple hardware accelerators to optimize memory usage for high-parameter models.

    Rust
    在 GitHub 上查看↗91,445
  • bitcoin/bitcoinbitcoin 的头像

    bitcoin/bitcoin

    89,442在 GitHub 上查看↗

    This project is a cryptographic consensus engine and distributed ledger client that functions as a peer-to-peer network node. It enables decentralized network participation by allowing users to independently validate transactions and blocks, ensuring data integrity and consensus without reliance on a centralized authority. The software utilizes an unspent transaction output model to track ownership and verify state transitions across the network. What distinguishes this implementation is its commitment to verifiable security and deterministic operation. It features a reproducible build system

    Acts as a secure gateway for authenticated node management, transaction broadcasting, and data retrieval.

    C++bitcoinc-plus-pluscryptocurrency
    在 GitHub 上查看↗89,442
  • louislam/uptime-kumalouislam 的头像

    louislam/uptime-kuma

    88,107在 GitHub 上查看↗

    Uptime Kuma is a self-hosted monitoring platform designed to track the availability and performance of network services and websites. It functions as a centralized dashboard that executes asynchronous health checks on a scheduled interval, providing real-time visibility into infrastructure health and service uptime. The platform distinguishes itself through a dedicated notification engine that dispatches alerts across multiple third-party messaging services, alongside a public status page generator that allows users to communicate service health and historical metrics via custom domains. Its

    Maintains persistent bidirectional connections to push live status updates to clients without requiring manual polling.

    JavaScriptdockermonitormonitoring
    在 GitHub 上查看↗88,107
  • modelcontextprotocol/serversmodelcontextprotocol 的头像

    modelcontextprotocol/servers

    87,320在 GitHub 上查看↗

    The Model Context Protocol is a standardized communication framework designed to connect language models to external data sources, functional tools, and interactive user interfaces. It provides a vendor-neutral interface layer that enables AI hosts to discover and execute capabilities across heterogeneous service environments, using a JSON-RPC based messaging standard to facilitate bidirectional communication between clients and servers. The protocol distinguishes itself through a robust capability-based handshake that negotiates feature sets during session initialization, ensuring compatibil

    Implements a JSON-RPC messaging standard to define bidirectional communication patterns for distributed service architectures.

    TypeScript
    在 GitHub 上查看↗87,320
  • syncthing/syncthingsyncthing 的头像

    syncthing/syncthing

    85,400在 GitHub 上查看↗

    Syncthing 是一个去中心化的文件同步引擎,通过点对点网状网络在多个设备间保持一致的数据状态。它作为后台守护进程运行,在受信任的节点之间自动复制文件的创建、修改和删除,无需中央服务器。通过利用内容可寻址块索引和块级增量同步,系统仅识别并传输文件的修改部分,从而确保在异构环境中高效地传播数据。 该项目以安全优先的架构著称,依赖相互 TLS 认证来验证设备身份,确保所有连接在加密上绑定到受信任的证书指纹。它支持灵活的同步模式,包括双向复制、用于备份的单向镜像以及基于引用的强制执行。为了增加隐私性,系统为不受信任的设备提供了文件夹级加密,并允许对网络流量进行细粒度控制,包括限制操作仅在本地网络进行或利用中继基础设施进行 NAT 穿透。 除了核心复制功能外,该平台还提供全面的管理工具,包括用于监控连接状态和吞吐量的 Web 仪表板,以及用于高级配置的命令行界面。它包含强大的版本控制策略以防止数据丢失,并通过原生服务集成和可观测性指标支持复杂的部署场景。该软件专为跨平台兼容性而设计,可通过标准包管理器或容器化环境安装。

    Operates as a background service that automatically replicates file modifications across remote systems as soon as they come online.

    Gogop2ppeer-to-peer
    在 GitHub 上查看↗85,400
  • localsend/localsendlocalsend 的头像

    localsend/localsend

    83,448在 GitHub 上查看↗

    LocalSend is a cross-platform utility designed for secure, peer-to-peer file transfers between devices on the same local network. By establishing direct, encrypted communication channels, the application enables users to share files without relying on external servers, cloud storage, or active internet connectivity. The project distinguishes itself through a unified codebase that supports native-looking interfaces across desktop and mobile operating systems. It utilizes automated peer discovery to identify available devices on a subnet and employs end-to-end encryption to ensure data integrit

    Protects data integrity and privacy through end-to-end encryption during direct peer-to-peer communication.

    Dartdartfile-sharingflutter
    在 GitHub 上查看↗83,448
上一个123456…23下一个
  1. Home
  2. Networking & Communication
  3. Distributed Systems and Peer-to-Peer
  4. Distributed Computing

探索子标签

  • Ability-Based Distributed ExecutorsRunning computations across remote nodes using an effect system that handles dependency deployment and execution without external frameworks. **Distinct from Distributed Computing:** Distinct from Distributed Computing: focuses on using an effect system for distributed execution, not general cluster computing frameworks.
  • Bytecode Shipping EnginesShip a function's bytecode tree to a remote location and sync missing dependencies on the fly, enabling distributed execution without pre-deployment setup. **Distinct from Distributed Computing:** Distinct from Distributed Computing: focuses on shipping bytecode and syncing dependencies on the fly, not general distributed task execution.
  • Communication Protocols8 个子标签Standards and mechanisms for inter-process communication.
  • Consensus and Coordination Systems4 个子标签Algorithms and services for maintaining global state, agreement, and topology across distributed nodes.
  • Data Synchronization and Consistency8 个子标签Frameworks and protocols for managing data state, replication, and consistency models across distributed environments.
  • Data-Colocated ComputationExecuting computational logic on the specific nodes where the required data is stored to minimize network movement. **Distinct from Distributed Computing:** Distinct from general Distributed Computing: specifically refers to the 'data-locality' or colocation pattern where logic moves to data.
  • Deterministic ID Generation2 个子标签Computing unique identifiers based on parent IDs and keys rather than random generation. **Distinct from Distributed ID Generators:** Focuses on deterministic computation from seeds/parents rather than globally unique random IDs.
  • Distributed Crawl CoordinationMechanisms for partitioning and synchronizing web discovery tasks across multiple worker nodes.
  • Distributed Execution Runtimes2 个子标签Infrastructure layers for orchestrating general-purpose parallel tasks, batch jobs, and inference workloads.
  • Distributed ID Generators3 个子标签Algorithms and services for creating globally unique IDs.
  • Hierarchical Metric Aggregation1 个子标签Parent-child node relationships for data forwarding and centralization.
  • Hierarchical ScalingArchitectures that use parent-child relationships to scale data collection and retention.
  • Model Parallelism Techniques5 个子标签Methods for partitioning neural network layers, tensors, or parameters across hardware to overcome memory and compute constraints.
  • Private Distributed ComputationDistributed execution of computations where the underlying data is kept private through encryption. **Distinct from Distributed Computing:** Distinct from Distributed Computing: specifies that the computation is performed privately/encrypted, not just across multiple machines.
  • Remote Procedure Call Frameworks3 个子标签Frameworks that facilitate remote execution of functions and inter-process communication across distributed system components.