awesome-repositories.com
博客
awesome-repositories.com

通过 AI 驱动的搜索,发现最优秀的开源仓库。

探索精选搜索开源替代品自托管软件博客网站地图
项目关于排名机制媒体报道MCP 服务器
法律隐私政策服务条款
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·

20 个仓库

Awesome GitHub RepositoriesAsynchronous Processing Pipelines

Systems for executing resource-intensive tasks in the background to maintain application responsiveness.

Distinguishing note: Focuses on the architectural pattern of background task execution rather than specific data processing or UI concerns.

Explore 20 awesome GitHub repositories matching software engineering & architecture · Asynchronous Processing Pipelines. Refine with filters or upvote what's useful.

Awesome Asynchronous Processing Pipelines GitHub Repositories

用 AI 发现最棒的仓库。我们将通过 AI 为您搜索最匹配的仓库。
  • rssnext/foloRSSNext 的头像

    RSSNext/Folo

    38,546在 GitHub 上查看↗

    Folo is a centralized RSS feed aggregator designed to consolidate digital content from multiple sources into a single, unified reading interface. It utilizes a local-first data architecture, employing a relational database to store feed metadata and article content, which ensures that information remains accessible and searchable even without an active internet connection. The application distinguishes itself through an integrated intelligent content processor that leverages asynchronous pipelines to translate foreign languages and generate concise summaries of long-form articles. To maintain

    Executes resource-intensive tasks like language translation and text summarization in the background to keep the main interface responsive.

    TypeScriptaireaderrss
    在 GitHub 上查看↗38,546
  • guovin/iptv-apiGuovin 的头像

    Guovin/iptv-api

    24,341在 GitHub 上查看↗

    This project is an automated service designed for the management, validation, and distribution of live television stream sources. It functions as an integrated pipeline that collects disparate media feeds and organizes them into structured, standardized playlists compatible with various third-party media players. The system distinguishes itself through continuous background operations that maintain content reliability. It performs active network probing to test latency and connectivity, automatically pruning broken or unreliable links. Simultaneously, it acts as a middleware layer that interc

    Executes continuous background tasks to ingest, validate, and filter media streams without blocking the primary application interface.

    Pythonauto-updateawesomeepg
    在 GitHub 上查看↗24,341
  • pouchdb/pouchdbpouchdb 的头像

    pouchdb/pouchdb

    17,583在 GitHub 上查看↗

    PouchDB is a JavaScript NoSQL document database that runs directly in the browser. It serves as an offline-first data store that allows applications to save state and user data locally using persistent storage. The database is compatible with CouchDB, implementing its API to enable synchronization between browser environments and remote servers. This allows for cross-device data syncing and the development of local-first software that operates without a constant internet connection. The project covers data storage and synchronization capabilities, including the ability to migrate database sc

    Uses an asynchronous pipeline to process database operations without blocking the main execution thread.

    JavaScript
    在 GitHub 上查看↗17,583
  • keycastr/keycastrkeycastr 的头像

    keycastr/keycastr

    14,608在 GitHub 上查看↗

    Keycastr is a system-level utility for macOS that captures and displays keyboard and mouse interactions as visual overlays on the desktop. By registering global event taps within the operating system, it monitors input actions in real time and renders them through transparent, non-interactive windows that float above other active applications. The application distinguishes itself through a plugin-based architecture that allows for the integration of custom modules to define how input events are rendered. Users can manage the lifecycle and positioning of these visual elements through a native

    Decouples input capture from rendering to maintain high performance during rapid keystroke sequences.

    Objective-C
    在 GitHub 上查看↗14,608
  • blinue/magpieBlinue 的头像

    Blinue/Magpie

    13,291在 GitHub 上查看↗

    Magpie is a desktop utility designed to enhance the visual fidelity and resolution of running applications through real-time graphics post-processing. It functions by intercepting the desktop frame buffer and applying spatial reconstruction and interpolation algorithms to upscale visual content during active playback. The system distinguishes itself by integrating a programmable graphics pipeline that allows for the injection of custom shaders directly into the display stream. Beyond visual enhancement, it provides an automation interface that enables programmatic control over application beh

    Decouples frame capture from transformation tasks to maintain performance during intensive image manipulation.

    HLSLanime4kcapturecppwinrt
    在 GitHub 上查看↗13,291
  • contains-studio/agentscontains-studio 的头像

    contains-studio/agents

    12,239在 GitHub 上查看↗

    This project is an orchestration framework designed to automate creative and research workflows by managing specialized artificial intelligence agents. It functions as a content generation system that delegates complex, multi-step tasks to model instances, ensuring that each agent operates within defined behavioral constraints and design methodologies. The framework distinguishes itself through its focus on structural integrity and brand consistency. It employs schema-driven validation to ensure that all generated content adheres to predefined templates and data formats. By utilizing custom s

    Manages long-running inference requests in the background to maintain responsiveness during intensive generation.

    在 GitHub 上查看↗12,239
  • unopim/unopimunopim 的头像

    unopim/unopim

    8,878在 GitHub 上查看↗

    unopim is an AI-powered product information management system that serves as a centralized repository for managing product attributes, categories, and variations. It functions as a containerized product repository and a multi-channel data distributor, synchronizing consistent product information and pricing across diverse external sales platforms and marketplaces. The platform distinguishes itself through an LLM-based catalog manager that provides a conversational interface for executing data management tasks. This allows users to perform item creation, content enrichment, and quality scans u

    Processes high-volume product data imports and exports in the background with real-time status tracking.

    PHPlaravelopen-sourceopensource
    在 GitHub 上查看↗8,878
  • sindresorhus/gifskisindresorhus 的头像

    sindresorhus/Gifski

    8,456在 GitHub 上查看↗

    Gifski is a native macOS desktop application and video processing utility designed to convert video files into high-quality animated GIFs. It functions as a video-to-GIF converter that allows for the adjustment of frame rates and dimensions to balance visual fidelity with file size. The tool features capabilities for animation loop generation, including the creation of bounce effects by reversing video playback. It employs palette-based color quantization and error-diffusion dithering to maintain color accuracy and reduce banding in the final output. The application integrates with macOS sys

    Implements a background processing pipeline to handle resource-intensive video encoding without blocking the user interface.

    Swiftappconvert-videosconverter
    在 GitHub 上查看↗8,456
  • civitai/civitaicivitai 的头像

    civitai/civitai

    7,158在 GitHub 上查看↗

    Civitai is a platform for generative media creation and AI model distribution. It provides a centralized service for producing images, videos, audio, and music, while serving as a repository where users can share, discover, and browse custom model weights and fine-tuned adaptations. The platform distinguishes itself through a provider-agnostic orchestration layer that manages multi-step generation pipelines and complex workflows across different backends. It integrates with autonomous AI agents and editors via the Model Context Protocol, allowing external tools to access generation pipelines

    Offloads resource-intensive tasks like upscaling and transcription to background processing pipelines.

    TypeScriptaisocial-networkstable-diffusion
    在 GitHub 上查看↗7,158
  • luckjiawei/frpc-desktopluckjiawei 的头像

    luckjiawei/frpc-desktop

    6,768在 GitHub 上查看↗

    frpc-desktop is a cross-platform desktop application that provides a graphical interface for managing FRP intranet penetration tunnels. It combines FRP binary downloading, visual configuration editing, tunnel lifecycle management, and shareable link generation into a single tool, allowing users to tunnel local network services to the public internet through a relay server without manually editing configuration files or managing binaries. The application wraps a web frontend inside an Electron shell for native window management across operating systems, and handles the full lifecycle of the FR

    Spawns the FRP client as a child process and pipes its output into the UI for real-time status.

    Vuedesktopelectronfrp
    在 GitHub 上查看↗6,768
  • done-0/fuck-u-codeDone-0 的头像

    Done-0/fuck-u-code

    6,830在 GitHub 上查看↗

    This project is an AI-powered code reviewer and static analysis server that identifies low-quality files and generates automated critiques. It functions as an automated quality scoring tool that evaluates source code structure and complexity through local parsing. The system utilizes a standardized context protocol to stream analysis results to AI agents and editors. It integrates large language models to produce automated reviews and suggestions for improvement based on quantitative quality metrics. The tool includes a weight-based scoring engine and an asynchronous analysis pipeline for pr

    Utilizes a concurrency-controlled queue to process multiple files in parallel via an asynchronous pipeline.

    TypeScript
    在 GitHub 上查看↗6,830
  • openshot/openshot-qtOpenShot 的头像

    OpenShot/openshot-qt

    5,481在 GitHub 上查看↗

    This project is an open-source video production suite and non-linear video editor. It provides a multi-track timeline for cutting, splicing, and arranging video and audio clips with frame-level precision, serving as a comprehensive workspace for video post-production. The suite includes specialized tools for keyframe animation, allowing for the creation of 2D and 3D visual effects and motion graphics. It also features a multi-track audio mixer for blending sound sources and adjusting levels to accompany visual content. Capability areas cover a full post-production workflow, including color c

    Implements background processing pipelines to handle resource-intensive rendering without freezing the user interface.

    Pythonc-plus-plusffmpeggplv3
    在 GitHub 上查看↗5,481
  • ramjke/translumoramjke 的头像

    ramjke/Translumo

    5,454在 GitHub 上查看↗

    Translumo is an optical character recognition screen translator and multi-engine orchestrator. It extracts text from active application windows in real time to translate content into different languages, facilitating the localization of software that lacks official translation options. The system distinguishes itself by combining results from several recognition engines and using machine learning to determine the most accurate text extraction. It also functions as a proxy rotating gateway, cycling through IP addresses to prevent translation services from blocking high-volume requests. The pr

    Implements background processing for screen captures and network requests to keep the user interface responsive.

    C#autotranslateeasyocrgame-translation
    在 GitHub 上查看↗5,454
  • zilliztech/claude-contextzilliztech 的头像

    zilliztech/claude-context

    5,373在 GitHub 上查看↗

    Claude-context is a retrieval-augmented generation pipeline and semantic code search tool. It functions as an LLM codebase indexer and RAG context provider, designed to index local directories and retrieve relevant code files to provide context for large language models. The system operates as a hybrid search engine that combines keyword matching with dense vector search. This allows for the retrieval of code snippets and logic using natural language queries based on meaning rather than exact text matches. The project covers codebase indexing and search index management, utilizing asynchrono

    Implements an asynchronous pipeline to process large codebases in the background without blocking the main application thread.

    TypeScriptagentagentic-ragai-coding
    在 GitHub 上查看↗5,373
  • astriaai/headshots-starterastriaai 的头像

    astriaai/headshots-starter

    4,461在 GitHub 上查看↗

    本项目是一个 AI 证件照生成器和 SaaS 样板,旨在通过上传的照片训练自定义模型,以制作专业的、高分辨率的肖像照。它作为一个图像生成流水线和模型训练编排器,管理处理用户图像以创建风格化头像的全流程。 该系统包含一个基于积分的货币化框架,通过自动化 Webhook 处理支付。它为 AI 驱动的服务提供了完整的基础设施,整合了用户账户管理和自动化电子邮件通知,以便在生成的图像准备好下载时提醒用户。 该平台涵盖了训练照片的收集、专业肖像风格的选择以及 4K 分辨率图像的生产。它还包括增强图像质量的功能,以确保最终肖像保持自然和逼真的美感。

    Implements a background processing pipeline to handle resource-intensive AI image generation without blocking the user interface.

    TypeScript
    在 GitHub 上查看↗4,461
  • googlesamples/mlkitgooglesamples 的头像

    googlesamples/mlkit

    4,248在 GitHub 上查看↗

    该存储库是用于将设备端机器学习 API 集成到移动应用程序中的示例应用程序和参考项目集合。它提供了 Android 和 iOS 的实现示例,演示了如何嵌入计算机视觉和自然语言处理模型。 该项目涵盖了移动计算机视觉的实现,包括文本识别、人脸检测和条形码扫描。它包括实时图像处理的工作流,以及集成在设备上本地处理数据的预训练模型。

    Implements background processing pipelines to ensure heavy ML computations do not freeze the mobile user interface.

    Javabarcodebarcode-scannerface-detection
    在 GitHub 上查看↗4,248
  • oklai/koalaoklai 的头像

    oklai/koala

    3,952在 GitHub 上查看↗

    Koala 是一个用于管理 Web 资源预处理器编译、转译和后台监控的图形用户界面。它作为一个构建工具,将 Less、Sass 和 CoffeeScript 文件转换为浏览器兼容的 CSS 和 JavaScript。 该应用程序具有用于控制转换过程的可视化界面,无需命令行交互。它集成了一个后台文件监视器,当检测到本地文件系统发生更改时,会自动实时重新编译源文件。 该工具提供了用于管理全局和项目特定编译设置的实用程序,包括用于压缩编译代码的后处理压缩功能。它还包含一个捕获编译器输出以检测并报告语法错误的通知系统。

    Employs a non-blocking architectural pattern to execute compilation tasks in the background, ensuring the graphical user interface remains responsive.

    JavaScript
    在 GitHub 上查看↗3,952
  • introlab/rtabmapintrolab 的头像

    introlab/rtabmap

    3,836在 GitHub 上查看↗

    This project is a comprehensive library and toolkit for simultaneous localization and mapping, designed to construct three-dimensional environment models while tracking device position. It functions as a robotics perception framework that processes data from RGB-D, stereo, and lidar sensors to enable autonomous navigation and spatial awareness. The system distinguishes itself through its focus on long-term mapping and global consistency. It employs a sophisticated loop-closure detection engine and graph-based pose optimization to identify previously visited locations and eliminate cumulative

    Executes resource-intensive mapping tasks in background threads to maintain real-time system responsiveness.

    C++
    在 GitHub 上查看↗3,836
  • vladmandic/humanvladmandic 的头像

    vladmandic/human

    2,999在 GitHub 上查看↗

    Human is a TensorFlow.js computer vision library used for face, body, and hand tracking within the browser or Node.js. It provides a framework for human pose and gesture tracking, facial recognition, and biometric liveness detection to verify a live human presence. The project distinguishes itself through a full suite of identity and motion tools, including a facial recognition framework that generates embeddings for similarity matching and a background segmenter for separating humans from their environment. It incorporates a liveness detector to prevent spoofing during facial analysis. The

    Implements asynchronous pipelines to handle heavy model execution in background threads, maintaining browser responsiveness.

    HTMLage-estimationbody-segmentationbody-tracking
    在 GitHub 上查看↗2,999
  • specterops/bloodhoundSpecterOps 的头像

    SpecterOps/BloodHound

    2,789在 GitHub 上查看↗

    BloodHound is an identity risk management platform and graph-based attack path analyzer used to map identity relationships and permissions in Active Directory. It functions as a security tool for auditing directory services, uncovering unintended privilege relationships, and visualizing sequences of permissions that can lead to domain compromise. The project differentiates itself as a comprehensive adversary emulation framework that coordinates remote agents and executes post-exploitation commands. It includes a reverse proxy for bypassing multi-factor authentication via real-time session hij

    Implements an asynchronous pipeline to extract credentials and metadata from uploaded files in the background.

    Go
    在 GitHub 上查看↗2,789
  1. Home
  2. Software Engineering & Architecture
  3. Asynchronous Processing Pipelines

探索子标签

  • Interactive Process Spawning2 个子标签Launching separate system processes to allow interactive command-line sessions without blocking the main application. **Distinct from Asynchronous Processing Pipelines:** Distinct from Asynchronous Processing Pipelines: focuses on interactive CLI session management rather than automated data pipelines.