2 Repos
Awesome GitHub RepositoriesResource-Aware Parallelization
Mechanisms for calculating system resources to dynamically optimize the number of concurrent execution units.
Distinct from Custom Parallel Task Execution: Distinct from Custom Parallel Task Execution by specifically focusing on hardware resource-aware scaling rather than just workload decomposition.
Explore 2 awesome GitHub repositories matching development tools & productivity · Resource-Aware Parallelization. Refine with filters or upvote what's useful.
Awesome Resource-Aware Parallelization GitHub Repositories
Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
- google/wireit
google/wireit
6,409Auf GitHub ansehenWireit is a build system orchestrator and npm script task runner that manages complex dependencies between scripts. It functions as a development workflow automator by tracking input files and dependencies to skip redundant executions and optimize total build time. The project features a content-addressable build cache that saves generated files to bypass expensive computations. It includes a file watcher that monitors project changes and automatically triggers only the affected scripts within a dependency graph. The tool covers task orchestration through parallel script execution, backgroun
Limits simultaneous process spawns based on available CPU cores to prevent system resource exhaustion.
TypeScript - omkarcloud/botasaurus
omkarcloud/botasaurus
3,970Auf GitHub ansehenBotasaurus is a Python web scraping framework and headless browser automation system used to build scalable data extraction tools. It functions as a web data extraction tool and OCR document parser, converting website content, images, and PDF files into structured formats such as JSON, CSV, and Excel. The framework distinguishes itself by providing a scraper management interface that allows Python functions to be wrapped in a web-based UI or deployed as standalone desktop applications. This enables non-technical users to trigger extraction jobs and manage tasks via a graphical interface or RE
Implements a system that calculates available memory to determine the optimal number of concurrent browser instances for data extraction.
Pythonanti-botanti-detectanti-detect-browser
