Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.
RubyRetriever (http://softwarebyjoe.com/rubyretriever/)
A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
A batteries-included framework for easy web-scraping. Just add CSS! (Or do more.)
Web crawler with very flexible crawling options. Can either use standalone or can be used with resque to perform clustered crawls.
Les fonctionnalités principales de stewartmckee/cobweb sont : Ruby Crawling Frameworks.
Les alternatives open-source à stewartmckee/cobweb incluent : felipecsl/wombat — Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages. joenorton/rubyretriever — [RubyRetriever] (http://softwarebyjoe.com/rubyretriever/). postmodern/spidr — A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is… propublica/upton — A batteries-included framework for easy web-scraping. Just add CSS! (Or do more.). sparklemotion/mechanize — Mechanize is a Ruby library for web browser automation and headless browser emulation. It allows for programmatically… sparklemotion/nokogiri — Nokogiri is an XML and HTML parsing library that builds navigable document trees from strings, files, or URLs using…