awesome-repositories.com
Blog
awesome-repositories.com

Descoperă cele mai bune repository-uri open source cu căutare AI.

ExploreazăCăutări recomandateAlternative open-sourceSoftware self-hostedBlogHartă site
ProiectDespreCum realizăm clasamentulPresăServer MCP
LegalConfidențialitateTermeni
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·

20 repository-uri

Awesome GitHub RepositoriesAsynchronous Processing Pipelines

Systems for executing resource-intensive tasks in the background to maintain application responsiveness.

Distinguishing note: Focuses on the architectural pattern of background task execution rather than specific data processing or UI concerns.

Explore 20 awesome GitHub repositories matching software engineering & architecture · Asynchronous Processing Pipelines. Refine with filters or upvote what's useful.

Awesome Asynchronous Processing Pipelines GitHub Repositories

Găsește cele mai bune repo-uri cu AI.Vom căuta cele mai potrivite repository-uri folosind AI.
  • rssnext/foloAvatar RSSNext

    RSSNext/Folo

    38,546Vezi pe GitHub↗

    Folo is a centralized RSS feed aggregator designed to consolidate digital content from multiple sources into a single, unified reading interface. It utilizes a local-first data architecture, employing a relational database to store feed metadata and article content, which ensures that information remains accessible and searchable even without an active internet connection. The application distinguishes itself through an integrated intelligent content processor that leverages asynchronous pipelines to translate foreign languages and generate concise summaries of long-form articles. To maintain

    Executes resource-intensive tasks like language translation and text summarization in the background to keep the main interface responsive.

    TypeScriptaireaderrss
    Vezi pe GitHub↗38,546
  • guovin/iptv-apiAvatar Guovin

    Guovin/iptv-api

    24,341Vezi pe GitHub↗

    This project is an automated service designed for the management, validation, and distribution of live television stream sources. It functions as an integrated pipeline that collects disparate media feeds and organizes them into structured, standardized playlists compatible with various third-party media players. The system distinguishes itself through continuous background operations that maintain content reliability. It performs active network probing to test latency and connectivity, automatically pruning broken or unreliable links. Simultaneously, it acts as a middleware layer that interc

    Executes continuous background tasks to ingest, validate, and filter media streams without blocking the primary application interface.

    Pythonauto-updateawesomeepg
    Vezi pe GitHub↗24,341
  • pouchdb/pouchdbAvatar pouchdb

    pouchdb/pouchdb

    17,583Vezi pe GitHub↗

    PouchDB is a JavaScript NoSQL document database that runs directly in the browser. It serves as an offline-first data store that allows applications to save state and user data locally using persistent storage. The database is compatible with CouchDB, implementing its API to enable synchronization between browser environments and remote servers. This allows for cross-device data syncing and the development of local-first software that operates without a constant internet connection. The project covers data storage and synchronization capabilities, including the ability to migrate database sc

    Uses an asynchronous pipeline to process database operations without blocking the main execution thread.

    JavaScript
    Vezi pe GitHub↗17,583
  • keycastr/keycastrAvatar keycastr

    keycastr/keycastr

    14,608Vezi pe GitHub↗

    Keycastr is a system-level utility for macOS that captures and displays keyboard and mouse interactions as visual overlays on the desktop. By registering global event taps within the operating system, it monitors input actions in real time and renders them through transparent, non-interactive windows that float above other active applications. The application distinguishes itself through a plugin-based architecture that allows for the integration of custom modules to define how input events are rendered. Users can manage the lifecycle and positioning of these visual elements through a native

    Decouples input capture from rendering to maintain high performance during rapid keystroke sequences.

    Objective-C
    Vezi pe GitHub↗14,608
  • blinue/magpieAvatar Blinue

    Blinue/Magpie

    13,291Vezi pe GitHub↗

    Magpie is a desktop utility designed to enhance the visual fidelity and resolution of running applications through real-time graphics post-processing. It functions by intercepting the desktop frame buffer and applying spatial reconstruction and interpolation algorithms to upscale visual content during active playback. The system distinguishes itself by integrating a programmable graphics pipeline that allows for the injection of custom shaders directly into the display stream. Beyond visual enhancement, it provides an automation interface that enables programmatic control over application beh

    Decouples frame capture from transformation tasks to maintain performance during intensive image manipulation.

    HLSLanime4kcapturecppwinrt
    Vezi pe GitHub↗13,291
  • contains-studio/agentsAvatar contains-studio

    contains-studio/agents

    12,239Vezi pe GitHub↗

    This project is an orchestration framework designed to automate creative and research workflows by managing specialized artificial intelligence agents. It functions as a content generation system that delegates complex, multi-step tasks to model instances, ensuring that each agent operates within defined behavioral constraints and design methodologies. The framework distinguishes itself through its focus on structural integrity and brand consistency. It employs schema-driven validation to ensure that all generated content adheres to predefined templates and data formats. By utilizing custom s

    Manages long-running inference requests in the background to maintain responsiveness during intensive generation.

    Vezi pe GitHub↗12,239
  • unopim/unopimAvatar unopim

    unopim/unopim

    8,878Vezi pe GitHub↗

    unopim is an AI-powered product information management system that serves as a centralized repository for managing product attributes, categories, and variations. It functions as a containerized product repository and a multi-channel data distributor, synchronizing consistent product information and pricing across diverse external sales platforms and marketplaces. The platform distinguishes itself through an LLM-based catalog manager that provides a conversational interface for executing data management tasks. This allows users to perform item creation, content enrichment, and quality scans u

    Processes high-volume product data imports and exports in the background with real-time status tracking.

    PHPlaravelopen-sourceopensource
    Vezi pe GitHub↗8,878
  • sindresorhus/gifskiAvatar sindresorhus

    sindresorhus/Gifski

    8,456Vezi pe GitHub↗

    Gifski is a native macOS desktop application and video processing utility designed to convert video files into high-quality animated GIFs. It functions as a video-to-GIF converter that allows for the adjustment of frame rates and dimensions to balance visual fidelity with file size. The tool features capabilities for animation loop generation, including the creation of bounce effects by reversing video playback. It employs palette-based color quantization and error-diffusion dithering to maintain color accuracy and reduce banding in the final output. The application integrates with macOS sys

    Implements a background processing pipeline to handle resource-intensive video encoding without blocking the user interface.

    Swiftappconvert-videosconverter
    Vezi pe GitHub↗8,456
  • civitai/civitaiAvatar civitai

    civitai/civitai

    7,158Vezi pe GitHub↗

    Civitai is a platform for generative media creation and AI model distribution. It provides a centralized service for producing images, videos, audio, and music, while serving as a repository where users can share, discover, and browse custom model weights and fine-tuned adaptations. The platform distinguishes itself through a provider-agnostic orchestration layer that manages multi-step generation pipelines and complex workflows across different backends. It integrates with autonomous AI agents and editors via the Model Context Protocol, allowing external tools to access generation pipelines

    Offloads resource-intensive tasks like upscaling and transcription to background processing pipelines.

    TypeScriptaisocial-networkstable-diffusion
    Vezi pe GitHub↗7,158
  • luckjiawei/frpc-desktopAvatar luckjiawei

    luckjiawei/frpc-desktop

    6,768Vezi pe GitHub↗

    frpc-desktop is a cross-platform desktop application that provides a graphical interface for managing FRP intranet penetration tunnels. It combines FRP binary downloading, visual configuration editing, tunnel lifecycle management, and shareable link generation into a single tool, allowing users to tunnel local network services to the public internet through a relay server without manually editing configuration files or managing binaries. The application wraps a web frontend inside an Electron shell for native window management across operating systems, and handles the full lifecycle of the FR

    Spawns the FRP client as a child process and pipes its output into the UI for real-time status.

    Vuedesktopelectronfrp
    Vezi pe GitHub↗6,768
  • done-0/fuck-u-codeAvatar Done-0

    Done-0/fuck-u-code

    6,830Vezi pe GitHub↗

    This project is an AI-powered code reviewer and static analysis server that identifies low-quality files and generates automated critiques. It functions as an automated quality scoring tool that evaluates source code structure and complexity through local parsing. The system utilizes a standardized context protocol to stream analysis results to AI agents and editors. It integrates large language models to produce automated reviews and suggestions for improvement based on quantitative quality metrics. The tool includes a weight-based scoring engine and an asynchronous analysis pipeline for pr

    Utilizes a concurrency-controlled queue to process multiple files in parallel via an asynchronous pipeline.

    TypeScript
    Vezi pe GitHub↗6,830
  • openshot/openshot-qtAvatar OpenShot

    OpenShot/openshot-qt

    5,481Vezi pe GitHub↗

    This project is an open-source video production suite and non-linear video editor. It provides a multi-track timeline for cutting, splicing, and arranging video and audio clips with frame-level precision, serving as a comprehensive workspace for video post-production. The suite includes specialized tools for keyframe animation, allowing for the creation of 2D and 3D visual effects and motion graphics. It also features a multi-track audio mixer for blending sound sources and adjusting levels to accompany visual content. Capability areas cover a full post-production workflow, including color c

    Implements background processing pipelines to handle resource-intensive rendering without freezing the user interface.

    Pythonc-plus-plusffmpeggplv3
    Vezi pe GitHub↗5,481
  • ramjke/translumoAvatar ramjke

    ramjke/Translumo

    5,454Vezi pe GitHub↗

    Translumo is an optical character recognition screen translator and multi-engine orchestrator. It extracts text from active application windows in real time to translate content into different languages, facilitating the localization of software that lacks official translation options. The system distinguishes itself by combining results from several recognition engines and using machine learning to determine the most accurate text extraction. It also functions as a proxy rotating gateway, cycling through IP addresses to prevent translation services from blocking high-volume requests. The pr

    Implements background processing for screen captures and network requests to keep the user interface responsive.

    C#autotranslateeasyocrgame-translation
    Vezi pe GitHub↗5,454
  • zilliztech/claude-contextAvatar zilliztech

    zilliztech/claude-context

    5,373Vezi pe GitHub↗

    Claude-context is a retrieval-augmented generation pipeline and semantic code search tool. It functions as an LLM codebase indexer and RAG context provider, designed to index local directories and retrieve relevant code files to provide context for large language models. The system operates as a hybrid search engine that combines keyword matching with dense vector search. This allows for the retrieval of code snippets and logic using natural language queries based on meaning rather than exact text matches. The project covers codebase indexing and search index management, utilizing asynchrono

    Implements an asynchronous pipeline to process large codebases in the background without blocking the main application thread.

    TypeScriptagentagentic-ragai-coding
    Vezi pe GitHub↗5,373
  • astriaai/headshots-starterAvatar astriaai

    astriaai/headshots-starter

    4,461Vezi pe GitHub↗

    Acest proiect este un generator de portrete AI și un boilerplate SaaS conceput pentru a antrena modele personalizate pe fotografii încărcate, pentru a produce portrete profesionale de înaltă rezoluție. Funcționează ca un pipeline de generare de imagini și un orchestrator de antrenare a modelelor care gestionează fluxul de lucru end-to-end de procesare a imaginilor utilizatorului pentru a crea avatare stilizate. Sistemul include un framework de monetizare bazat pe credite care gestionează plățile prin webhooks automatizate. Oferă o infrastructură completă pentru servicii bazate pe AI, încorporând gestionarea conturilor de utilizator și notificări automate prin e-mail pentru a alerta utilizatorii când imaginile generate sunt gata pentru descărcare. Platforma acoperă colectarea fotografiilor de antrenament, selecția stilurilor de portret profesional și producerea de imagini la rezoluție 4K. Include, de asemenea, capabilități pentru îmbunătățirea calității imaginii, pentru a asigura că portretele finale mențin o estetică naturală și realistă.

    Implements a background processing pipeline to handle resource-intensive AI image generation without blocking the user interface.

    TypeScript
    Vezi pe GitHub↗4,461
  • googlesamples/mlkitAvatar googlesamples

    googlesamples/mlkit

    4,248Vezi pe GitHub↗

    Acest repository este o colecție de aplicații eșantion și proiecte de referință pentru integrarea API-urilor de machine learning on-device în aplicațiile mobile. Oferă exemple de implementare atât pentru Android, cât și pentru iOS, demonstrând cum să încorporați modele de computer vision și procesare a limbajului natural. Proiectul acoperă implementarea computer vision-ului mobil, inclusiv recunoașterea textului, detectarea feței și scanarea codurilor de bare. Include workflow-uri pentru procesarea imaginilor în timp real și integrarea modelelor pre-antrenate care procesează datele local pe dispozitiv.

    Implements background processing pipelines to ensure heavy ML computations do not freeze the mobile user interface.

    Javabarcodebarcode-scannerface-detection
    Vezi pe GitHub↗4,248
  • oklai/koalaAvatar oklai

    oklai/koala

    3,952Vezi pe GitHub↗

    Koala is a graphical user interface for managing the compilation, transpilation, and background monitoring of web asset preprocessors. It serves as a build tool that converts Less, Sass, and CoffeeScript files into browser-compatible CSS and JavaScript. The application features a visual interface for controlling the transformation process, removing the need for command line interaction. It integrates a background file monitor that automatically recompiles source files in real time as changes are detected on the local filesystem. The tool provides utilities for managing global and project-spe

    Employs a non-blocking architectural pattern to execute compilation tasks in the background, ensuring the graphical user interface remains responsive.

    JavaScript
    Vezi pe GitHub↗3,952
  • introlab/rtabmapAvatar introlab

    introlab/rtabmap

    3,836Vezi pe GitHub↗

    This project is a comprehensive library and toolkit for simultaneous localization and mapping, designed to construct three-dimensional environment models while tracking device position. It functions as a robotics perception framework that processes data from RGB-D, stereo, and lidar sensors to enable autonomous navigation and spatial awareness. The system distinguishes itself through its focus on long-term mapping and global consistency. It employs a sophisticated loop-closure detection engine and graph-based pose optimization to identify previously visited locations and eliminate cumulative

    Executes resource-intensive mapping tasks in background threads to maintain real-time system responsiveness.

    C++
    Vezi pe GitHub↗3,836
  • vladmandic/humanAvatar vladmandic

    vladmandic/human

    2,999Vezi pe GitHub↗

    Human is a TensorFlow.js computer vision library used for face, body, and hand tracking within the browser or Node.js. It provides a framework for human pose and gesture tracking, facial recognition, and biometric liveness detection to verify a live human presence. The project distinguishes itself through a full suite of identity and motion tools, including a facial recognition framework that generates embeddings for similarity matching and a background segmenter for separating humans from their environment. It incorporates a liveness detector to prevent spoofing during facial analysis. The

    Implements asynchronous pipelines to handle heavy model execution in background threads, maintaining browser responsiveness.

    HTMLage-estimationbody-segmentationbody-tracking
    Vezi pe GitHub↗2,999
  • specterops/bloodhoundAvatar SpecterOps

    SpecterOps/BloodHound

    2,789Vezi pe GitHub↗

    BloodHound is an identity risk management platform and graph-based attack path analyzer used to map identity relationships and permissions in Active Directory. It functions as a security tool for auditing directory services, uncovering unintended privilege relationships, and visualizing sequences of permissions that can lead to domain compromise. The project differentiates itself as a comprehensive adversary emulation framework that coordinates remote agents and executes post-exploitation commands. It includes a reverse proxy for bypassing multi-factor authentication via real-time session hij

    Implements an asynchronous pipeline to extract credentials and metadata from uploaded files in the background.

    Go
    Vezi pe GitHub↗2,789
  1. Home
  2. Software Engineering & Architecture
  3. Asynchronous Processing Pipelines

Explorează sub-etichetele

  • Interactive Process Spawning2 sub-tag-uriLaunching separate system processes to allow interactive command-line sessions without blocking the main application. **Distinct from Asynchronous Processing Pipelines:** Distinct from Asynchronous Processing Pipelines: focuses on interactive CLI session management rather than automated data pipelines.