22 个仓库
Client-server patterns for initiating, monitoring, and completing extended operations with periodic feedback and cancellation.
Distinct from Client-Server Architecture: Distinct from Client-Server Architecture: focuses on long-running goal-based tasks with feedback and cancellation, not general state management.
Explore 22 awesome GitHub repositories matching software engineering & architecture · Long-Running Task Protocols. Refine with filters or upvote what's useful.
Hystrix is a latency and fault tolerance library designed to prevent cascading failures in distributed systems. It functions as a circuit breaker implementation that monitors failure thresholds and opens circuits to isolate remote calls when downstream services degrade. The project distinguishes itself by providing multiple isolation mechanisms, utilizing dedicated thread pools and semaphores to ensure that latency in one dependency does not saturate the entire system. It also features a request collapsing and batching engine that groups concurrent calls into single executions to reduce the t
Implements non-blocking execution patterns to handle long tasks without freezing the main execution thread.
该项目是一个高性能 BERT 嵌入服务和推理服务器,旨在将文本序列映射为固定长度的数值向量。它作为一个机器学习微服务和分布式模型服务器,将请求处理与繁重的计算解耦。 该系统利用 ZeroMQ 消息基础设施在分布式客户端和推理服务器之间提供低延迟通信。它结合了服务器端批处理和 GPU 工作负载扩展,以最大化硬件利用率并管理高请求量。 该平台通过在共享向量空间内为文本和图像生成跨模态嵌入来支持语义搜索基础设施。这实现了跨模态搜索、内容相关性排名以及基于视觉内容与文本描述之间语义对齐的结果重排序。 该服务可以作为可通过 gRPC、HTTP 或 WebSocket 协议访问的弹性微服务进行部署,具有用于处理大数据集的非阻塞双工流。
Features non-blocking duplex streaming for requests and responses to handle large datasets efficiently.
co is a JavaScript generator control flow library and non-blocking workflow engine. It manages asynchronous logic by using generators and promises to simulate a synchronous coding style. The project transforms generator functions into standard functions that return promises, ensuring compatibility with non-generator interfaces. It also functions as a promise-based asynchronous orchestrator that executes multiple operations concurrently through the recursive resolution of nested promise collections. The library provides high-level primitives for asynchronous flow control and non-blocking work
Implements non-blocking execution patterns to manage complex sequences of asynchronous events without freezing the thread.
This project is a front-end interview study guide and a collection of structured notes designed for technical job preparation. It serves as a comprehensive reference for web technologies, common technical interview questions, and JavaScript algorithm implementation. The notebook distinguishes itself by integrating specialized guides for web performance optimization, browser API documentation, and JavaScript algorithm references. It provides a structured approach to solving coding challenges involving data structures like binary trees, linked lists, and array manipulation. The content covers
Covers the use of promises and callbacks to execute non-blocking asynchronous tasks in the browser.
Genkit is an open-source framework for building AI-powered applications. It provides a unified interface for connecting to hundreds of generative AI models from multiple providers, enabling text, image, audio, and video generation through a single API. The framework structures multi-step AI interactions—including chat, retrieval-augmented generation, tool use, and agentic workflows—as composable, traceable flows with built-in streaming and state management. The framework distinguishes itself through a comprehensive developer toolkit that includes a command-line interface and a local developer
Sends partial results from AI workflows to the client as they are generated for improved responsiveness.
re-frame is a functional framework for building single-page applications in ClojureScript. It provides a centralized, immutable database that serves as the single source of truth for the entire application state, enforcing a strict unidirectional data flow where events trigger state transitions and subsequent view updates. The framework distinguishes itself through a reactive signal graph and an interceptor-based middleware pipeline. By treating application logic as a sequence of data-driven events and declarative side effects, it decouples business logic from the view layer. This architectur
Breaks CPU-intensive work into small chunks that yield control back to the browser.
Inngest is a durable execution framework and event-driven automation engine designed to orchestrate background workflows. It enables developers to build resilient, stateful processes by memoizing function steps, ensuring that long-running tasks can automatically resume from the last successful operation after failures, timeouts, or infrastructure restarts. The platform distinguishes itself through its event-driven architecture, which uses a schema-validated bus to trigger functions and coordinate complex, multi-step logic. It employs an onion-model middleware approach for cross-cutting concer
Provides protocols for interacting with and controlling long-running background tasks through event-based inputs.
ServiceStack 是一个高性能 .NET Web 框架,专为使用强类型请求和响应对象构建类型安全的 API 而设计。它作为一个基于消息的 API 引擎,将业务逻辑与传输层解耦,允许通过包括 HTTP、gRPC 和各种消息队列提供商在内的多种协议公开服务。 该框架的特点是其类型安全的 API 生成器,它从跨多种语言的服务元数据中生成原生客户端 SDK 和数据传输对象。它还包括用于微服务编排的分布式服务网关、将 C# 对象直接转换为数据库记录的代码优先 ORM,以及用于安全令牌访问的集中式身份和访问管理系统。 其更广泛的功能面涵盖通过 Pub-Sub 和服务器发送事件(SSE)进行的异步消息传递和实时事件流。它为 JSON、XML、ProtoBuf 和 MessagePack 等格式提供全面的数据序列化支持,以及包括 JWT、API 密钥和阶梯式认证在内的集成认证流程。其他工具包括自动 CRUD API 生成、后台作业执行和管理仪表盘模板。
Allows external web service requests to terminate active, long-running server-side operations.
ROS 2 is a distributed communication middleware for robot systems, built on a peer-to-peer Data Distribution Service (DDS) foundation. It provides a publish-subscribe messaging layer where typed data flows between decoupled components across a network, along with synchronous remote procedure calls and action-based task execution for long-running goals with periodic feedback. The framework includes an interface definition language that generates type-safe code for messages, services, and actions, ensuring cross-language compatibility, and supports fine-grained Quality of Service profiles that c
Provides a client-server protocol for long-running robot tasks with periodic feedback and cancellation.
NCCL 是一个高性能通信库和分布式 GPU 计算框架,专为在单节点或多节点系统中的多个 GPU 之间执行集合和点对点数据交换而设计。它充当 RDMA GPU 传输层和内存编排器,为分布式 GPU 训练和推理提供高带宽的数据和模型梯度同步。 该库的特色在于能够直接从 GPU 内核执行通信原语,将主机 CPU 从关键路径中移除。它利用拓扑感知路径选择来优化数据移动,并采用包括 InfiniBand 和 NVLink 在内的基于 RDMA 的网络传输,以实现设备跨不同物理节点之间的零拷贝内存访问。 该项目涵盖了广泛的集合通信模式,包括归约(Reductions)、广播(Broadcasts)、收集(Gathers)和全对全交换(All-to-all exchanges),以及点对点远程内存访问。它提供全面的通信器管理,用于初始化、分区和调整 GPU 组大小,以及用于注册缓冲区和协调共享设备内存的专用内存管理。 该系统包括一套用于健康跟踪、诊断日志记录和实时事件监控的监控与可观测性工具,以及用于机器学习框架、CUDA Graphs、MPI 和 Python 的集成接口。
Implements non-blocking thread behavior to allow multiple threads to manage data exchanges independently without freezing execution.
Amp 是一个 PHP 的非阻塞并发框架。它为编写异步应用提供了核心基础设施,使用事件循环在单个进程内调度操作、计时器和信号。 该项目实现了一个利用纤程 (fibers) 来挂起和恢复函数执行的协程库。这允许系统在不阻塞主执行线程的情况下处理并发任务,从而在输入和输出操作期间优化 CPU 使用率。它进一步通过 Future 和 Promise 实现来管理挂起的操作结果。 该框架涵盖了广泛的协调功能,包括非阻塞 I/O 多路复用、用于中止长时间运行操作的基于令牌的任务取消,以及用于等待多个并发任务完成的策略。它还包括用于循环任务调度和执行暂停的机制。
Pauses a specific execution flow for a set duration while allowing other concurrent operations to continue.
XcodeBuildMCP is a Model Context Protocol server and development tool bridge that provides AI agents with the ability to control xcodebuild, manage simulators, and automate the compilation and execution of Apple platform applications. It functions as a persistent daemon that proxies native IDE build and debug capabilities to external clients and agents. The project distinguishes itself by using the Model Context Protocol to expose build and device management tools through a standardized interface. It implements specialized skill priming and instruction configuration to ensure AI agents can in
Streams progress and subprocess output continuously during long-running build and test tasks.
Kùzu is an embedded property graph database engine designed for high-performance analytical queries and local data management. It operates as a library within the host application process, utilizing a columnar-based storage architecture and just-in-time query compilation to execute complex graph traversals and pattern matching efficiently. By mapping database files directly into system memory, it ensures data durability and high-speed access while maintaining ACID-compliant transactional integrity. The engine distinguishes itself by integrating vector similarity search and full-text search di
Supports concurrent database operations using blocking or non-blocking interfaces.
Ballerina is a cloud-native programming language and distributed services framework designed for building and integrating networked services. It provides a network-aware runtime that manages non-blocking input and output operations to support scalable distributed systems. The platform features a visual programming environment that maintains bidirectional synchronization between source code and graphical sequence diagrams. It utilizes a structural type system to decouple independent software components and includes a cloud infrastructure generator that produces Docker and Kubernetes deployment
Features a network-aware runtime that manages concurrent requests and non-blocking asynchronous I/O operations.
bcrypt.js is a portable JavaScript implementation of the bcrypt algorithm used for securely hashing and verifying user passwords. It functions as a credential security utility that protects stored passwords against brute-force attacks through the use of salts and configurable work factors. The library is designed as a pure JavaScript cryptographic module, allowing it to run in any JavaScript environment, including both server-side Node.js and client-side web browsers, without requiring native system binaries or C++ bindings. It is a zero-dependency standalone module to minimize security risks
Provides asynchronous API paths to perform computationally expensive password hashing without blocking the JavaScript event loop.
EternalTerminal is a persistent SSH remote shell and secure remote terminal. It functions as a TCP connection manager that automatically restores shell sessions after network disconnects, ensuring a continuous connection between a client and server. The project enables the maintenance of a persistent remote shell, allowing users to resume active sessions and recover terminal states immediately after a network failure or manual reconnection. This ensures that long-running processes and scripts on a remote server continue executing even when the local client loses its connection. The system pr
Ensures that scripts and commands on a remote server continue executing even when the local client disconnects.
mosdns is a DNS forwarding server and traffic filter that routes DNS queries to multiple upstream providers. It functions as a rule-based DNS router and a proxy for DNS-over-HTTPS and DNS-over-TLS to ensure secure DNS resolution. The system utilizes a pipeline-based request processing model and rule-based query routing to direct specific domain queries to different upstream servers. It implements pluggable transport layers and forwarding protocols, including HTTPS, TLS, and QUIC, to encrypt traffic and prevent eavesdropping. The project includes capabilities for upstream load balancing to di
Provides concurrent query execution using asynchronous tasks to handle multiple DNS requests simultaneously.
This project provides a translation layer and set of adapters designed to bridge AI agents with the Model Context Protocol. It functions as an integration layer that allows agents to operate as protocol-compliant servers and enables the conversion of protocol-based tools into formats compatible with agent frameworks and logic graphs. The adapters facilitate tool interoperability by wrapping external protocol tools for use within agent workflows and exposing internal agent capabilities to any client implementing the Model Context Protocol. This creates a communication bridge that supports inte
Streams real-time output from active agent runs with support for resuming from specific event IDs.
Eloquent-JavaScript is a comprehensive JavaScript programming textbook and interactive coding tutorial designed for web development education. It serves as both a language reference and a practical guide, combining theoretical lessons with an environment where learners can execute and modify code examples. The project focuses on the fundamental principles of the JavaScript language, including lexical scoping, prototype-based inheritance, and asynchronous patterns. It provides detailed instruction on object-oriented programming, functional programming, and the use of the browser DOM to create
Explains how to run long-running actions in the background to keep the user interface responsive.
The AWS SDK for Java is a set of client libraries providing a programmatic interface for managing cloud resources and services through the Java language and JVM. It serves as a cloud service client library for executing synchronous and asynchronous API calls to infrastructure components. The library is distinguished by its use of non-blocking asynchronous I/O and a reactive cloud client model, utilizing publishers and subscribers to stream data and manage backpressure. It employs a modular design to decouple services and reduce binary size, while utilizing immutable builders for thread-safe c
Employs non-blocking asynchronous I/O to execute network requests without stalling application threads.