1 Repo
Awesome GitHub RepositoriesCrawler Specification Management
Tools for creating, updating, and organizing the configuration files that define how a web crawler behaves.
Distinct from Project Metadata Specifications: Specifically manages spider configurations and resource definitions rather than general project metadata or linting rules.
Explore 1 awesome GitHub repository matching devops & infrastructure · Crawler Specification Management. Refine with filters or upvote what's useful.
Awesome Crawler Specification Management GitHub Repositories
Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
- scrapinghub/portia
scrapinghub/portia
9,509Auf GitHub ansehenPortia is a containerized scraping platform and visual web scraper that enables no-code data extraction. It serves as a Scrapy visual scraping tool and spider generator, allowing users to design and deploy web scrapers through a graphical interface instead of writing manual selector code. The system distinguishes itself by converting visual web page annotations into executable Scrapy spider code and structured JSON specifications. This visual-to-code mapping allows users to define scraping logic and extraction rules through a point-and-click interface, which can then be exported for use in ex
Provides capabilities to upload, modify, and delete spider configurations and resource definitions for specific scraping projects.
Python
