2 个仓库
Awesome GitHub RepositoriesAsynchronous Request Runners
Background execution engines for high-concurrency network tasks.
Distinguishing note: Focuses on non-blocking network execution for scraping.
Explore 2 awesome GitHub repositories matching web development · Asynchronous Request Runners. Refine with filters or upvote what's useful.
Awesome Asynchronous Request Runners GitHub Repositories
用 AI 发现最棒的仓库。我们将通过 AI 为您搜索最匹配的仓库。
- gocolly/colly
gocolly/colly
25,101在 GitHub 上查看Colly is a high-performance web scraping framework designed for the automated extraction of structured data from websites. It provides a programmable toolkit that manages the complexities of large-scale data collection, including concurrent request orchestration, automatic cookie handling, and robots.txt compliance. By utilizing an asynchronous execution model, the engine maintains high throughput while preventing resource exhaustion during recursive or distributed crawling tasks. The framework is distinguished by its modular, event-driven architecture, which allows developers to hook into sp
Performs network requests in the background to keep the application responsive during large-scale extraction.
Gocrawlercrawlingframework - qd-today/qd
qd-today/qd
5,525在 GitHub 上查看qd is a server-side execution engine and request scheduler designed to automate recurring network tasks. It functions as a task automator that converts HTTP Archive files into reusable request templates for scheduled execution. The system is powered by a non-blocking server that manages a timer-driven execution engine. This allows the project to orchestrate API tasks by replaying captured network traffic and triggering network requests based on defined recurring intervals. The tool covers a broad range of automation capabilities, including schema-driven task configuration and stateless reque
Implements a server-side execution engine for managing and triggering high-concurrency recurring HTTP network tasks.
Pythoncheckindockerhar
