1 dépôt
Awesome GitHub RepositoriesAutomated Export Pipelines
Workflows that automatically route extracted data from sources to various storage destinations and formats.
Distinct from Data Export Pipelines: Covers the end-to-end pipeline from scraping to storage, distinct from simple file serializers or telemetry streams.
Explore 1 awesome GitHub repository matching data & databases · Automated Export Pipelines. Refine with filters or upvote what's useful.
Awesome Automated Export Pipelines GitHub Repositories
Trouvez les meilleurs dépôts grâce à l'IA.Nous recherchons les dépôts les plus pertinents grâce à l'IA.
- itsowen/cyberscraper-2077
itsOwen/CyberScraper-2077
2,887Voir sur GitHubCyberScraper-2077 is an AI-powered web scraping tool that uses large language models to extract and structure data from websites into organized formats. It functions as an LLM web scraper and AI content parser, transforming unstructured raw web text into specific data schemas. The project distinguishes itself through a suite of anonymity and evasion tools, including proxy rotation, SOCKS-based identity masking, and the ability to route traffic through the Tor network to access hidden onion services. It further includes a bot detection bypass system that employs stealth parameters and custom n
Provides automated pipelines that extract web content and save it directly to JSON, CSV, SQL, or Google Sheets.
Pythonai-scrapinggemini-apillm
