awesome-repositories.com
Blog
awesome-repositories.com

Descubre los mejores repositorios open-source con nuestra búsqueda potenciada por IA.

ExplorarBúsquedas curadasAlternativas open-sourceSoftware autohospedableBlogMapa del sitio
ProyectoAcerca deCómo clasificamosPrensaServidor MCP
Aviso legalPrivacidadTérminos
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·

14 repositorios

Awesome GitHub RepositoriesTask Queues

Sequential processing of tasks using a queue to manage system resource consumption.

Distinct from Batch Processing: Focuses on the queueing mechanism for file processing rather than bulk data operations

Explore 14 awesome GitHub repositories matching data & databases · Task Queues. Refine with filters or upvote what's useful.

Awesome Task Queues GitHub Repositories

Encuentra los mejores repositorios con IA.Buscaremos los repositorios que mejor coincidan usando IA.
  • imageoptim/imageoptimAvatar de ImageOptim

    ImageOptim/ImageOptim

    9,873Ver en GitHub↗

    ImageOptim is a macOS image optimizer and GUI image compressor designed to reduce image file sizes for web and disk storage. It functions as a lossless image optimizer that removes unnecessary metadata and optimizes encoding to reduce file sizes without losing pixel data. The application handles macOS media asset management and web image preparation by shrinking files to improve website loading speeds and reduce storage usage. It provides both lossless and lossy compression options to maintain visual quality while reducing the disk space used by images.

    Manages a queue of images to process them sequentially and prevent system resource exhaustion.

    HTML
    Ver en GitHub↗9,873
  • yaobiao131/downkyicoreAvatar de yaobiao131

    yaobiao131/downkyicore

    7,450Ver en GitHub↗

    downkyicore is a cross-platform desktop application designed for the automated batch downloading of Bilibili videos, including support for high-resolution 8K and HDR content. It functions as a batch media downloader that manages multiple files and collections simultaneously through an automated queue system. The project integrates FFmpeg for media processing to separate audio and video streams and remove watermarks. It uses specialized mechanisms to bypass access restrictions and rate limits by employing random identifiers and mobile referrers during the parsing process. The system includes

    Manages a sequential queue of download tasks using a local database to handle batch processing and retries.

    C#avaloniabilibili
    Ver en GitHub↗7,450
  • tubearchivist/tubearchivistAvatar de tubearchivist

    tubearchivist/tubearchivist

    7,561Ver en GitHub↗

    TubeArchivist is a self-hosted YouTube video archiving system and metadata indexer. It functions as a personal media library and download manager that allows users to create a searchable offline collection of videos, channels, and playlists. The system distinguishes itself by indexing subtitles, comments, and channel information for full-text search and retrieval. It features automated media synchronization to track subscriptions and playlists, ensuring new content is automatically queued and downloaded as it is published. The project provides a broad set of capabilities for digital asset ma

    Processes pending items in a sequential download queue to retrieve files for offline storage.

    Pythonarchivedownload-managerdownload-videos
    Ver en GitHub↗7,561
  • j3ssie/osmedeusAvatar de j3ssie

    j3ssie/Osmedeus

    6,425Ver en GitHub↗

    Osmedeus is a security workflow orchestration engine that coordinates AI agents, shell commands, and scanning tools through declarative YAML pipelines. It functions as a distributed security scanner, a declarative workflow automator, and an AI agent framework for security, enabling automated multi-step security analysis with conditional branching, parallel execution, and distributed workers. The engine distinguishes itself through a hybrid runner model that executes workflow steps on the local host, inside Docker containers, or over SSH to remote machines, selected per step or module. It supp

    Enqueues scan tasks for later execution with configurable concurrency limits.

    Go
    Ver en GitHub↗6,425
  • ccostan/home-assistantconfigAvatar de CCOSTAN

    CCOSTAN/Home-AssistantConfig

    5,176Ver en GitHub↗

    This repository is a collection of YAML automations and scripts for Home Assistant that coordinate devices and services into context‑aware home routines. Its design centers on combining multiple sensor inputs—motion, bed presence, garage door state—into a single occupancy signal that gates automations, reducing false triggers. The collection delivers actionable mobile notifications with script‑bound buttons for snoozing or escalating alerts, and integrates an external vision service to classify camera snapshots so package deliveries are detected and announced. What distinguishes this configur

    Processes tasks one at a time from a persistent queue with per-task time thresholds and delay guards.

    Pythonaialexaautomation
    Ver en GitHub↗5,176
  • nickvisionapps/parabolicAvatar de NickvisionApps

    NickvisionApps/Parabolic

    5,106Ver en GitHub↗

    Parabolic is a graphical frontend for the yt-dlp engine, serving as a web media downloader and extractor. It provides a visual interface for saving high-quality video and audio content from various web platforms into local files. The application functions as a multi-format media exporter, allowing content to be saved into diverse audio and video containers. It includes a media metadata manager to capture and store associated information, such as subtitles and technical metadata, alongside the downloaded files. The system supports batch content acquisition through concurrent download manageme

    Coordinates multiple simultaneous download tasks using a worker queue to optimize system resource consumption.

    C#csharpdownloaderflathub
    Ver en GitHub↗5,106
  • wxbool/video-srt-windowsAvatar de wxbool

    wxbool/video-srt-windows

    5,037Ver en GitHub↗

    Esta es una aplicación de Windows para el reconocimiento automático de voz que transcribe audio hablado de archivos de vídeo a archivos de subtítulos SRT con marca de tiempo. Sirve como un generador de subtítulos y herramienta de traducción que convierte el habla de los medios en texto sincronizado. El software funciona como un transcriptor de medios por lotes, permitiendo el procesamiento simultáneo de múltiples archivos de audio y vídeo para generar subtítulos de forma masiva. Incluye un flujo de trabajo de traducción para convertir transcripciones entre diferentes idiomas para la creación de archivos bilingües o localizados. El sistema también proporciona capacidades de refinamiento de texto, utilizando expresiones regulares y filtros personalizados para limpiar transcripciones eliminando palabras de relleno y patrones no deseados. Esto está soportado por una interfaz gráfica de usuario nativa de Windows.

    Uses a task queue to process multiple media files sequentially and manage system resources.

    Goffmpeggogolang
    Ver en GitHub↗5,037
  • rudderlabs/rudder-serverAvatar de rudderlabs

    rudderlabs/rudder-server

    4,437Ver en GitHub↗

    Rudder Server es una plataforma de datos de clientes y una tubería de enrutamiento de eventos diseñada para recopilar, transformar y enrutar datos de eventos de clientes desde diversas fuentes a almacenes de datos y herramientas de negocio. Funciona como un resolutor de identidad de clientes, vinculando identificadores de múltiples fuentes para construir un gráfico de identidad unificado y perfiles de clientes conductuales integrales. El sistema se diferencia por sus capacidades de ETL inverso, que envían segmentos y audiencias de clientes procesados desde almacenes de datos de vuelta a aplicaciones operativas de terceros. También proporciona un plano de datos contenedorizado para despliegues en Kubernetes, permitiendo la gestión de la infraestructura de datos como código. La plataforma cubre una amplia gama de capacidades de gestión de datos, incluyendo la transformación de eventos en tiempo real, la validación de esquemas mediante catálogos de datos y la gobernanza de la privacidad. Estas incluyen herramientas para gestionar el consentimiento del usuario, hacer cumplir la residencia de datos dentro de regiones geográficas específicas y enmascarar información de identificación personal durante el tránsito. La instalación y el despliegue de los componentes del plano de datos se gestionan utilizando gráficos de Helm.

    Schedules bulk data uploads and synchronization tasks using a priority queue to manage system load.

    Gobigquerycdpcustomer-data
    Ver en GitHub↗4,437
  • bioruebe/uniextract2Avatar de Bioruebe

    Bioruebe/UniExtract2

    4,344Ver en GitHub↗

    UniExtract2 es un conjunto de herramientas diseñado para la extracción universal de archivos, descompresión por lotes y análisis de formatos de archivo. Recupera archivos de varios formatos comprimidos, instaladores de software, imágenes de disco y archivos de juegos en directorios locales. El proyecto incluye un analizador de formato de archivo que identifica los tipos de archivo escaneando los contenidos internos y los encabezados sin requerir la extracción completa. También cuenta con un descifrador de contraseñas de archivos que intenta recuperar el acceso a archivos protegidos utilizando una lista predefinida de contraseñas comunes. La herramienta admite flujos de trabajo de descompresión masiva mediante procesamiento de colas por lotes y extracción recursiva de directorios para manejar estructuras de archivos anidadas. Además, proporciona la capacidad de analizar los contenidos internos de instaladores de software e imágenes de disco sin ejecutar el proceso de instalación.

    Uses a task queue to manage the sequential decompression of multiple archive files.

    AutoItdecompressionextractorfile-analysis
    Ver en GitHub↗4,344
  • denizsafak/abogenAvatar de denizsafak

    denizsafak/abogen

    4,135Ver en GitHub↗

    Abogen is a text-to-speech audiobook generator that transforms digital documents and subtitle files into audiobooks. It utilizes language models to perform text normalization, rewriting contractions and punctuation to produce more natural speech synthesis. The system features a voice profile mixer that blends multiple voice models using adjustable weight ratios to create personalized synthetic voices. It also includes an automated export system that sends completed audio files and metadata to a remote Audiobookshelf server via a web API. The project manages the end-to-end audiobook productio

    Manages a queue of document processing tasks with support for per-file configuration overrides.

    Pythonaudiobookaudiobookscontent-creation
    Ver en GitHub↗4,135
  • ripmeapp/ripmeAvatar de RipMeApp

    RipMeApp/ripme

    4,041Ver en GitHub↗

    Ripme is a batch media downloader and web media scraper designed for extracting images and videos from image-hosting platforms and social media sites. It functions as an image gallery downloader and a network client capable of retrieving full albums and paginated content. The project includes a custom media ripper framework that allows for the definition of new extraction rules to support websites lacking native support. It features a proxy-enabled network layer for routing requests through HTTP or SOCKS servers and supports session-based content retrieval using authentication cookies and cus

    Scans web pages for linked galleries and adds them to a download queue for batch processing.

    Javaalbumarchivalarchive
    Ver en GitHub↗4,041
  • neoapplications/neo-backupAvatar de NeoApplications

    NeoApplications/Neo-Backup

    3,691Ver en GitHub↗

    Neo-Backup is an Android application backup tool and rooted device data manager. It creates encrypted copies of application data and system files on rooted devices to preserve application state and settings. The project functions as a backup scheduler, allowing for the automation of periodic data preservation tasks based on custom application lists and fixed timetables. To protect sensitive information, it utilizes password-based encryption to secure backup archives. The system provides capabilities for device-wide data backup and recovery, including the ability to restore applications and t

    Implements a sequential task queue to manage multiple data extraction jobs without overloading device resources.

    Kotlin
    Ver en GitHub↗3,691
  • taurusxin/ncmdumpAvatar de taurusxin

    taurusxin/ncmdump

    3,385Ver en GitHub↗

    ncmdump is a proprietary audio cache converter and binary stream decryption utility. It decrypts raw audio data from specialized music cache files and transforms them into standard audio formats. The project functions both as a standalone tool and a cross-language conversion library. It exposes its internal decryption and conversion logic as a dynamic library, allowing the capabilities to be embedded into external applications written in different programming languages. The utility provides batch media processing through recursive directory traversal, enabling the identification and conversi

    Manages a queue of target files for sequential processing to optimize resource usage.

    C++
    Ver en GitHub↗3,385
  • meeb/tubesyncAvatar de meeb

    meeb/tubesync

    2,625Ver en GitHub↗

    TubeSync is a containerized media management tool and self-hosted archiver designed to automate the downloading and organization of video content from online sources, such as YouTube channels and playlists, into a local library for offline access. It functions as a download manager and metadata generator, utilizing a web interface to manage video subscriptions and synchronization settings. The system features a rule-based content filter that evaluates video metadata against user-defined conditions to determine which items enter the download queue. To handle restricted or age-gated content, it

    Manages download tasks in a database, processed sequentially by a worker process with real-time updates.

    Pythonmedia-serverplexpvr
    Ver en GitHub↗2,625
  1. Home
  2. Data & Databases
  3. Batch Processing
  4. Task Queues

Explorar subetiquetas

  • Gallery Discovery QueuesQueues that automatically discover and add related web galleries for batch processing. **Distinct from Task Queues:** Distinct from general task queues by focusing on the discovery of linked galleries as the queue source.