How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
Pattern is a Python web mining library that functions as an HTML web scraper, a natural language processing toolkit, and a network analysis tool. It provides a mathematical framework for categorizing datasets through a vector space model library. The project enables the extraction of structured data from web services and the creation of searchable web content indexes. It processes unstructured text using sentiment analysis, part-of-speech tagging, and n-gram searching. The library covers machine learning classification through the training of models using perceptron algorithms and support ve
Flowsint is an open-source intelligence framework and reconnaissance orchestrator used for cybersecurity investigations. It functions as a containerized tool runner and data mapper, automating the collection of intelligence from open-source providers and APIs to profile targets and map threat intelligence. The platform distinguishes itself through a graph-based investigation interface, where processed raw intelligence is converted into nodes and edges to visualize relationships between entities. It allows for the creation of sequenced pipelines that chain data enrichment tools, enabling the o
Lychee is a command line link checker written in Rust that scans websites and local files to identify broken hyperlinks and invalid email addresses. It functions as an asynchronous link validator and static site auditor designed to ensure content accessibility and quality. The tool features disk-based response caching to accelerate subsequent scans and avoid redundant network requests. It supports token-based API authentication for services like GitHub to bypass rate limits when verifying links on remote repositories. The project covers a range of capabilities including multi-format content
Changedetection.io is a self-hosted monitoring service designed to track web pages for content updates and notify users of changes. It functions as a centralized platform where users can manage tracking tasks, observe specific website elements, and receive automated alerts through various communication channels whenever modifications are detected. The service distinguishes itself through an integrated headless browser engine that executes interaction sequences, such as logins or form submissions, to access dynamic or restricted content. It maintains a historical record of page snapshots, util
Intelligent web page comparison tool with Wayback Machine support and visual regression testing
The main features of geiserx/website-diff are: Visual Regression Testing, Web Crawling and Scraping.
Projects with overlapping indexed features include: clips/pattern — Pattern is a Python web mining library that functions as an HTML web scraper, a natural language processing toolkit,… lycheeverse/lychee — Lychee is a command line link checker written in Rust that scans websites and local files to identify broken… reconurge/flowsint — Flowsint is an open-source intelligence framework and reconnaissance orchestrator used for cybersecurity… clarabez/appium-1 — :iphone: Automation for iOS, Android, and Windows Apps. dgtlmoon/changedetection.io — Changedetection.io is a self-hosted monitoring service designed to track web pages for content updates and notify… mojoaxel/awesome-regression-testing — 🕶️ A curated list of resources around the topic: visual regression testing.