20 Repos
Background processing for high-latency operations.
Explore 20 awesome GitHub repositories matching devops & infrastructure · Asynchronous Task Queuing. Refine with filters or upvote what's useful.
FreeDomain is a centralized platform for managing the full lifecycle of domain names, providing services for free registration and web presence activation. It offers a unified administrative interface that allows users to secure digital identities across multiple top-level extensions and configure hosting environments through a guided setup process. The platform distinguishes itself through an API-driven orchestration layer that automates interactions with external registrars and simplifies complex infrastructure management by abstracting DNS configurations into standardized zone file updates
Processes high-latency domain activation requests in the background to keep the interface responsive during external API operations.
This project is an educational platform and research toolkit designed to teach deep learning through a combination of mathematical theory, visual diagrams, and executable code. It provides a comprehensive environment for building, training, and evaluating neural networks, grounding complex concepts in interactive computational notebooks that allow for hands-on experimentation. The framework distinguishes itself by interleaving theoretical foundations—including linear algebra, calculus, and probability—with practical implementations across multiple industry-standard libraries. It supports flex
Ensures system synchronization by waiting for queued backend operations to complete.
FastMCP is a Python framework designed for building servers that expose functions, resources, and prompts to AI models using the Model Context Protocol. It simplifies the development process by automatically deriving tool metadata, input schemas, and documentation directly from Python function signatures and type hints. The framework provides a unified container for managing these components, allowing developers to build modular applications that integrate seamlessly with AI assistants. The project distinguishes itself through its support for interactive, server-defined user interface compone
Runs blocking synchronous functions in a separate thread pool to prevent stalling the main event loop.
Mihon is a content aggregation client and manga reader application designed to manage digital comic libraries. It provides a centralized interface for organizing personal collections and tracking reading progress across various series. The application distinguishes itself through a modular architecture that supports dynamic extension loading, allowing users to integrate third-party content sources directly into the interface. It enables aggregated content discovery by executing concurrent searches across multiple providers, consolidating results into a unified view. Beyond basic reading, the
Manages background network requests and synchronization jobs to prevent interface blocking during heavy data fetching.
PydanticAI is a Python framework designed for building production-grade autonomous agents. It provides a unified interface for interacting with diverse language models, enabling developers to construct agents that perform complex tasks through structured data validation, tool execution, and multi-turn conversation management. The library centers on type-safe schema enforcement, ensuring that model inputs and outputs remain consistent and reliable throughout the agent's lifecycle. The framework distinguishes itself through a robust architecture that emphasizes modularity and testability. It ut
Runs synchronous tool functions and callbacks in dedicated threads to prevent blocking in long-running server environments.
node-redis is a Node.js client and database driver for interacting with Redis key-value stores. It functions as a connection manager and data iterator, allowing applications to execute database commands and manage atomic transactions on a remote server using asynchronous JavaScript. The project provides specialized capabilities for handling large datasets through an asynchronous interface and supports connection pooling to isolate blocking operations. It includes support for client-side caching and token-based authentication via Entra ID. The driver covers a broad range of operational areas,
Enables asynchronous task queuing and background job management using Redis as a message broker.
New-Grad-Positions is a centralized job aggregation platform designed to track and filter entry-level career opportunities for recent graduates across technical industries. The system functions as an automated career search tool, utilizing a relational database schema to organize job listings and user profiles for efficient querying. The platform distinguishes itself through integrated browser-based automation that populates online job application fields to reduce manual data entry. It further supports career search automation by monitoring new listings and triggering email alerts based on sp
Distributes heavy scraping and form-filling operations across background workers to maintain system responsiveness.
Rayon is a data parallelism library for Rust that provides a framework for converting sequential computations into parallel operations. It enables the transformation of standard data structures and loops into parallel iterators, allowing workloads to be distributed across multiple processor cores. By utilizing a work-stealing scheduler, the library dynamically balances tasks to maximize throughput and minimize execution time. The library distinguishes itself through its focus on safe, scoped task synchronization, which ensures that all spawned operations complete before a scope exits to preve
Ensures memory safety by guaranteeing all spawned parallel operations complete before the parent scope exits.
Night is a developer community platform designed to facilitate peer-to-peer learning and technical knowledge management. It functions as a collaborative space where users can organize study groups, curate engineering resources, and host technical discussions to support ongoing professional development. The system operates as a relational database application that manages complex interactions between users, learning materials, and collaborative session metadata. It incorporates a role-based access control framework to enforce permissions and restrict administrative actions through token valida
Offloads resource-intensive operations to background worker processes to maintain application responsiveness.
Coder is a self-hosted platform for provisioning and managing isolated, containerized development environments. It provides a centralized infrastructure for teams to deploy ephemeral workspaces on private cloud or on-premises hardware, ensuring consistent toolchains and dependencies across distributed development environments. The platform distinguishes itself through its focus on secure, infrastructure-as-code governance and autonomous agent integration. It allows organizations to define reusable, versioned environment templates that integrate with existing identity providers and role-based
Queues follow-up instructions while an agent is actively processing to maintain workflow continuity.
This repository provides a comprehensive library of code examples for implementing event-driven, serverless backend architectures. It serves as a practical guide for building scalable cloud-native applications that execute logic in isolated environments, triggered by infrastructure events or HTTP requests rather than persistent server processes. The collection demonstrates how to leverage managed infrastructure to automate backend workflows, including the use of asynchronous task queuing to maintain system stability during high traffic. It highlights patterns for secure API hosting, enabling
Offloads intensive operations to asynchronous queues to prevent request timeouts.
Bytebot is an LLM desktop automation framework and virtual Linux desktop environment. It enables AI agents to plan and execute mouse and keyboard actions on a virtual computer using natural language, allowing for autonomous desktop automation and the integration of legacy systems that lack native APIs. The system operates as an LLM API gateway and a Model Context Protocol server, routing requests across multiple language model providers with integrated load balancing and rate limiting. It provides isolated, containerized environments where agents use visual reasoning to interpret screenshots
Organizes and prioritizes asynchronous jobs with automatic recovery for failed actions.
Vendure is a Node.js e-commerce engine and headless commerce framework built with NestJS and TypeScript. It serves as a multi-channel commerce platform that manages product catalogs, orders, and customers via a strongly typed GraphQL API. The platform is distinguished by its highly extensible architecture, featuring a customizable administrative dashboard where developers can inject custom React components and entity views. It supports multi-channel commerce, allowing the isolation of products, currencies, and regional catalogs from a single unified backend. The engine covers a broad range o
Processes data synchronization jobs in the background with reliability and automatic retry mechanisms.
fast-check is a property-based testing framework and random data generator designed to verify software invariants by producing a wide range of randomized input data. It functions as a test data fuzzer that executes predicates against high volumes of random inputs to uncover edge cases and critical bugs. The project is distinguished by its ability to perform input-shrinking searches, which reduce complex failing inputs to their simplest form to isolate the exact cause of failure. It provides deterministic seed replay to exactly reproduce specific test failures and includes a concurrency testin
Waits for specific task completions or idle states to synchronize asynchronous execution during tests.
Presenton is an AI-powered presentation engine and API designed to transform natural language prompts, uploaded documents, and structured data into professional slide decks. It functions as a generation service that leverages large language models to automate the creation of outlines, slide content, and visual assets. The system is distinguished by its support for both cloud-based and self-hosted infrastructure, allowing for the integration of local language models and image generators to ensure data privacy. It implements a Model Context Protocol server, enabling external AI agents to trigge
Implements background processing for high-latency presentation generation jobs.
Discoart is a diffusion model orchestration framework and distributed GPU generation engine designed to automate and scale image generation workflows across hardware clusters. It functions as a generative AI model API, providing HTTP and gRPC endpoints to trigger and retrieve images from diffusion models as a network service. The system distinguishes itself through a comprehensive task management layer that includes timeline-based prompt and parameter scheduling. It manages the generative art lifecycle by supporting state-based session serialization for recovery, YAML-based configuration mana
Implements a non-blocking queue system to decouple API requests from intensive GPU processing.
Dieses Projekt ist eine webbasierte Plattform für Retrieval-Augmented Generation (RAG) und bietet ein Konversations-Interface, das Sprachmodelle mit privaten Dokumentensammlungen verbindet. Es fungiert als umfassendes System zur Verwaltung von Unternehmenswissensdatenbanken und ermöglicht es Benutzern, interne Dokumente abzufragen und kontextbezogene, quellenverifizierte Antworten über ein natürliches Sprach-Chat-Interface zu erhalten. Die Plattform zeichnet sich durch die Integration vektorbasierter semantischer Suche mit modularem Wissensdatenbank-Management aus, was die Aufnahme, Segmentierung und Indizierung von Dokumenten in durchsuchbare Embeddings ermöglicht. Sie unterstützt sichere Multi-User-Umgebungen durch die Implementierung sitzungsbasierter Authentifizierung und Autorisierung zum Schutz sensibler Informationen. Darüber hinaus ist das System darauf ausgelegt, hochvolumige Datenoperationen zu bewältigen, indem die Dokumentenverarbeitung an asynchrone Hintergrund-Worker ausgelagert und Modellantworten via Echtzeit-Streaming geliefert werden, um die Reaktionsfähigkeit des Interfaces zu wahren. Über ihre Kern-Konversationsfähigkeiten hinaus enthält das Framework Dienstprogramme für die Datenbankwartung, wie Backup und Wiederherstellung, und stellt Wissensabruffunktionen über Standard-APIs für die Integration in externe Anwendungen bereit. Das System ist darauf ausgelegt, sowohl lokale als auch Cloud-basierte Sprachmodelle zu unterstützen und bietet eine flexible Architektur für die Bereitstellung privater Dokumenten-Intelligenz-Tools.
Offloads document ingestion and heavy processing to background workers to maintain interface responsiveness.
OpenViking is a multi-tenant context server and knowledge base administration system designed to provide AI agents with persistent long-term memory. It enables the indexing of diverse documents and codebases to support retrieval-augmented generation, allowing agents to recall past interactions, user preferences, and learned experiences across sessions. The project is distinguished by its use of a URI-based virtual filesystem to organize memories, resources, and skills. It implements a tiered context loading system that balances retrieval precision with token budgets by structuring data into a
Blocks execution until all asynchronous embedding and semantic generation tasks in the queue are completed.
Paymenter ist eine Open-Source-Hosting-Automatisierungsplattform zur Verwaltung des Lebenszyklus digitaler Dienste und Infrastrukturen. Sie bietet ein zentrales System für Hosting-Anbieter zur Abwicklung der Kundenkontoverwaltung, wiederkehrender Abonnement-Abrechnungen und der automatisierten Bereitstellung virtueller, dedizierter und Spiel-spezifischer Serverinstanzen. Die Plattform zeichnet sich durch eine modulare Architektur aus, die umfangreiche Anpassungen und Integrationen von Drittanbietern unterstützt. Durch die Nutzung eines Plugin-basierten Systems und standardisierter Interface-Schichten ermöglicht sie Anbietern, Kern-Geschäftslogik und Infrastruktur-Management-Workflows an spezifische betriebliche Anforderungen anzupassen, ohne den zugrunde liegenden Quellcode zu modifizieren. Über die Kernfunktionen für Abrechnung und Bereitstellung hinaus enthält das System Tools für die Storefront-Entwicklung, Rechnungserstellung und administrative Aufsicht über Kundendienste. Es integriert rollenbasierte Zugriffskontrollen und Hintergrund-Task-Verarbeitung, um sichere, reaktionsfähige Operationen für Hosting-Umgebungen mit hohem Volumen aufrechtzuerhalten.
Processes asynchronous billing and provisioning tasks in the background to maintain system responsiveness.
Faveo Helpdesk is an open-source, self-hosted customer support platform designed to centralize inquiries from multiple communication channels into a unified dashboard. Built on the Laravel framework, it provides a structured environment for teams to track, prioritize, and resolve support requests through automated routing and management workflows. The platform distinguishes itself through its focus on automated support orchestration and service operations management. It includes a conversational workflow builder that allows for the creation of automated chat sequences and intelligent routing
Processes time-consuming operations asynchronously by pushing background jobs onto a queue for execution by separate worker processes.