2 个仓库
Awesome GitHub RepositoriesBatch Processing Utilities
Tools for processing large volumes of data in sequential groups to optimize throughput and resource usage.
Distinct from Batch Processing: Closest candidates are either cloud-specific or limited to audio processing; this is a general utility for sequential thread iteration.
Explore 2 awesome GitHub repositories matching data & databases · Batch Processing Utilities. Refine with filters or upvote what's useful.
Awesome Batch Processing Utilities GitHub Repositories
用 AI 发现最棒的仓库。我们将通过 AI 为您搜索最匹配的仓库。
- yangyangwithgnu/hardseed
yangyangwithgnu/hardseed
9,207在 GitHub 上查看Hardseed is a command-line forum media scraper and content archiver. It extracts images and torrent seeds from internet forums in bulk, saving the media and associated metadata to local directories. The tool utilizes a proxy-enabled web scraping engine that rotates network traffic through multiple proxy servers and protocols to bypass rate limits and network restrictions. It includes a keyword-based media filter that matches user-defined strings within entry titles to include or exclude specific topics. The system manages data extraction through batch-processed thread iteration and range-lim
Processes forum entries in sequenced groups to extract media without overloading the source server.
C++ - linsomniac/spotify_to_ytmusic
linsomniac/spotify_to_ytmusic
4,573在 GitHub 上查看spotifytoytmusic 是一个音乐库迁移工具，旨在将播放列表和喜欢的歌曲从 Spotify 转移到 YouTube Music。它作为一个跨平台同步工具，通过匹配两个流媒体提供商之间的歌曲元数据和标题来重建音乐库。 该工具提供完整的播放列表迁移和喜欢的歌曲转移功能，确保精选集在目标服务上得以重建。它还可用作备份工具，允许用户将音乐元数据和播放列表内容导出到本地文件，以防止提供商变更期间的数据丢失。 该系统通过 REST API 集成和 OAuth2 身份验证来管理这些传输，以安全地访问和修改用户账户。它采用基于元数据的曲目匹配来识别歌曲，并利用顺序批处理来处理大型收藏。
Processes large track collections in sequential groups to avoid hitting API rate limits.
Python
