2 dépôts
Concurrency control patterns that prevent multiple instances from processing the same request.
Distinct from Request Processing: Distinct from Request Processing: focuses on locking/deduplication logic rather than the general request lifecycle.
Explore 2 awesome GitHub repositories matching networking & communication · Request Locking Mechanisms. Refine with filters or upvote what's useful.
Crawlee is a web scraping framework designed for building scalable, reliable, and distributed data extraction pipelines. It provides a unified interface for managing headless browser automation and lightweight HTTP requests, allowing developers to handle complex web navigation, dynamic content rendering, and large-scale data collection within a single, modular architecture. The project distinguishes itself through its resource-aware concurrency controller, which dynamically scales task execution based on real-time CPU and memory usage to prevent host machine exhaustion. It also features a rob
Prevents concurrent processing of the same request by locking it during execution to maintain data integrity.
Fly is an HTTP client library and cross-platform network wrapper that provides a unified Promise-based interface for managing network requests across diverse JavaScript runtimes and operating systems. It functions as a multi-runtime request manager, abstracting underlying HTTP engines to ensure consistent behavior between browsers and native environments. The library features a middleware system for capturing and modifying outgoing requests and incoming responses through a request interceptor pipeline. It employs adapter-based engine switching to maintain a consistent API across different pla
Uses a lock mechanism to conditionally disable the interceptor processing pipeline for specific requests.