awesome-repositories.com
Blog
MCP
awesome-repositories.com

Discover the best open-source repositories with AI-powered search.

ExploreCurated searchesOpen-source alternativesSelf-hosted softwareBlogSitemap
ProjectMCP serverAboutHow we rankPress
LegalPrivacyTerms
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
joenorton avatar

joenorton/rubyretriever

0
View on GitHub↗
143 stars·25 forks·Ruby·11 viewsnorton.io/rubyretriever↗

Rubyretriever

[RubyRetriever] (http://softwarebyjoe.com/rubyretriever/)

Features

  • Ruby Crawling Frameworks - Web crawler, scraper, and file harvester.

Star history

Star history chart for joenorton/rubyretrieverStar history chart for joenorton/rubyretriever

How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.

AI search

Explore more awesome repositories

Describe what you need in plain English — the AI ranks thousands of curated open-source projects by relevance.

Start searching with AI

Frequently asked questions

What does joenorton/rubyretriever do?

[RubyRetriever] (http://softwarebyjoe.com/rubyretriever/)

What are the main features of joenorton/rubyretriever?

The main features of joenorton/rubyretriever are: Ruby Crawling Frameworks.

Which projects share features with joenorton/rubyretriever?

Projects with overlapping indexed features include: felipecsl/wombat — Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages. postmodern/spidr — A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is… propublica/upton — A batteries-included framework for easy web-scraping. Just add CSS! (Or do more.). sparklemotion/mechanize — Mechanize is a Ruby library for web browser automation and headless browser emulation. It allows for programmatically… sparklemotion/nokogiri — Nokogiri is an XML and HTML parsing library that builds navigable document trees from strings, files, or URLs using… stewartmckee/cobweb — Web crawler with very flexible crawling options. Can either use standalone or can be used with resque to perform…

Projects sharing features with Rubyretriever

These projects share indexed features with Rubyretriever. Shared tags can include platform or build tooling; verify the primary use case before treating a result as a replacement.
  • felipecsl/wombatfelipecsl avatar

    felipecsl/wombat

    1,362View on GitHub↗

    Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.

    Rubycrawlerdslruby
    View on GitHub↗1,362
  • postmodern/spidrpostmodern avatar

    postmodern/spidr

    837View on GitHub↗

    A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

    Ruby
    View on GitHub↗837
  • propublica/uptonpropublica avatar

    propublica/upton

    1,599View on GitHub↗

    A batteries-included framework for easy web-scraping. Just add CSS! (Or do more.)

    HTML
    View on GitHub↗1,599
  • sparklemotion/mechanizesparklemotion avatar

    sparklemotion/mechanize

    4,443View on GitHub↗

    Mechanize is a Ruby library for web browser automation and headless browser emulation. It allows for programmatically navigating websites and simulating human behavior without a graphical user interface. The library provides an automated interface for populating and submitting web forms, including text fields, checkboxes, and file uploads. It manages stateful sessions by automatically storing and sending cookies across multiple requests to maintain user authentication and identity. Additional capabilities include web data scraping, the ability to download remote web content, and the maintena

    Ruby
    View on GitHub↗4,443
Compare all 6 related projects→