2 Repos
Controlling when batched loads are dispatched through custom schedulers for manual or delayed execution.
Distinct from Batch Dispatching: Distinct from Batch Dispatching: focuses on scheduling the dispatch of batched data loads rather than sending multiple tasks to a queue.
Explore 2 awesome GitHub repositories matching devops & infrastructure · Custom Batch Dispatch Schedulers. Refine with filters or upvote what's useful.
DataLoader is a utility that collects individual data loads into a single batch and caches results to minimize redundant backend requests. It operates on a batch-and-cache architecture, where multiple data lookups within a single execution frame are grouped together and dispatched as one request, with the results stored in memory for instant retrieval on subsequent calls. The utility distinguishes itself through several key capabilities. It supports per-key error handling, allowing partial failures within a batch without rejecting the entire operation. A cache priming mechanism lets developer
Controls when batched loads are dispatched through custom schedulers for manual or delayed execution.
TikTokDownload is a configurable batch video downloader for TikTok and Douyin that strips watermarks and supports automated downloads from user profiles, likes, and collections. It functions as a social media content archiving tool, enabling users to download videos and audio from these platforms for offline viewing or personal backup. The project distinguishes itself through a modular download pipeline that combines audio extraction, batch scheduling, config-driven workflows, cookie-based authentication, URL parsing, paginated API scraping, and watermark removal. It uses a settings file to c
Implements a producer-consumer scheduler with rate limiting and retry logic for managing concurrent download tasks.