1 مستودع
Awesome GitHub RepositoriesIdentity Customization
Configuration of user agents and persistent data directories to mimic human browsing behavior.
Distinct from Browser Session Persistence: Focuses on customizing identity for automation, distinct from general session persistence.
Explore 1 awesome GitHub repository matching web development · Identity Customization. Refine with filters or upvote what's useful.
Awesome Identity Customization GitHub Repositories
اعثر على أفضل المستودعات باستخدام الذكاء الاصطناعي.سنبحث عن أفضل المستودعات المطابقة باستخدام الذكاء الاصطناعي.
- apify/crawlee
apify/crawlee
24,002عرض على GitHubCrawlee is a web scraping framework designed for building scalable, reliable, and distributed data extraction pipelines. It provides a unified interface for managing headless browser automation and lightweight HTTP requests, allowing developers to handle complex web navigation, dynamic content rendering, and large-scale data collection within a single, modular architecture. The project distinguishes itself through its resource-aware concurrency controller, which dynamically scales task execution based on real-time CPU and memory usage to prevent host machine exhaustion. It also features a rob
Sets custom user agent strings and persistent user data directories to mimic human browsing behavior and maintain state across multiple scraping sessions.
TypeScriptapifyautomationcrawler
