How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
The purpose of this project is to provide a nice DSL wrapper around the cumbersome htmlunit Java library. Here is an example taken from a unit test in this package:
Nov 20 2017 -- A distributed open source search engine and spider/crawler written in C/C++ for Linux on Intel/AMD. From gigablast dot com, which has binaries for download. See the README.md file at the very bottom of this page for instructions.
scrala is a web crawling framework for scala, which is inspired by scrapy.
The main features of gaocegege/scrala are: Other Language Crawlers.
Projects with overlapping indexed features include: a11ywatch/crawler — A gRPC web indexer turbo charged for performance. bplawler/crawler — The purpose of this project is to provide a nice DSL wrapper around the cumbersome htmlunit Java library. Here is an… gigablast/open-source-search-engine — Nov 20 2017 -- A distributed open source search engine and spider/crawler written in C/C++ for Linux on Intel/AMD.… hadley/rvest — Simple web scraping for R. matteoredaelli/ebot — EBOT (http://www.redaelli.org/matteo-blog/projects/ebot/) USAGE: see the wiki homepage… miyagawa/web-scraper — Web::Scraper - Web Scraping Toolkit using HTML and CSS Selectors or XPath expressions.
