gocrawl is a polite, slim and concurrent web crawler written in Go.
Crawl4AI is an AI-powered web crawling and data extraction engine designed to transform complex web content into structured formats. It functions as a headless browser orchestrator, enabling the navigation of dynamic websites, the execution of custom scripts, and the capture of visual assets like screenshots and PDFs. By integrating language models directly into the extraction workflow, the system converts raw HTML into clean, structured data or Markdown files optimized for downstream ingestion. The platform distinguishes itself through a distributed, self-hosted infrastructure that manages l
Pholcus is a distributed web crawler framework written in Go designed for high-concurrency data extraction. It functions as a distributed crawling orchestrator and dynamic data extraction engine, utilizing a server-client architecture to coordinate tasks across multiple nodes. The system integrates a headless browser engine to render dynamic content and execute JavaScript, allowing it to extract data from single-page applications. It features a web-based management interface for configuring spider parameters and monitoring execution progress, alongside the ability to update extraction rules v
Creeper is a next-generation crawler which fetches web page by creeper script. As a cross-platform embedded crawler, you can use it for your news app, subscribe program, etc.
Les fonctionnalités principales de montferret/ferret sont : Go Crawling Frameworks, Web Crawlers, Web Scraping.
Les alternatives open-source à montferret/ferret incluent : unclecode/crawl4ai — Crawl4AI is an AI-powered web crawling and data extraction engine designed to transform complex web content into… wspl/creeper — Creeper is a next-generation crawler which fetches web page by creeper script. As a cross-platform embedded crawler,… henrylee2cn/pholcus — Pholcus is a distributed web crawler framework written in Go designed for high-concurrency data extraction. It… puerkitobio/gocrawl — gocrawl is a polite, slim and concurrent web crawler written in Go. antivanov/js-crawler — js-crawler. alirezamika/autoscraper — Autoscraper is an automatic web scraping library and pattern-based data extractor that learns extraction rules from…