# knockoutez/wigolo

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/knockoutez-wigolo).**

_How this analysis was created: the description and tags below were written by an AI model that read this project's README and public documentation pages; stars, license and language come straight from the GitHub API. The model does not read the source code._

5,531 stars · 459 forks · TypeScript · NOASSERTION

## Links

- GitHub: https://github.com/KnockOutEZ/wigolo
- Homepage: https://wigolo.app
- awesome-repositories: https://awesome-repositories.com/repository/knockoutez-wigolo.md

## Topics

`agent` `ai` `ai-agent` `claude` `developer-tools` `exa-alternative` `firecrawl-alternative` `local-first` `mcp` `mcp-server` `metasearch` `model-context-protocol` `privacy` `rag` `search` `search-engine` `tavily-alternative` `web-crawler` `web-scraping` `web-search`

## Description

Wigolo is a local-first web research toolkit for AI agents. It runs as a Model Context Protocol server that gives coding agents web search, page fetching, crawling, and caching without API keys or cloud accounts. Search queries many public engines in parallel, merges results with rank fusion, and reranks them with on-device models, attaching an explainable relevance score to each result.

What sets it apart is the evidence it returns. Results carry verbatim excerpts pinned to positions in the source page, quotable citation IDs, and inspectable scores. Weak results are flagged as junk, and stale cache, failed engines, truncation, and bot-protected pages are reported as labeled failures rather than passed off as real content. An autonomous research mode plans, searches, fetches, and synthesizes cited answers within a time budget, using a configurable hosted or local language model, or returns a raw brief and evidence when none is set.

The same tools are available through MCP, a REST API with an OpenAPI contract, a command line and interactive shell, and typed TypeScript and Python SDKs. Page fetching escalates from plain HTTP to a headless browser when needed, and can click, type, scroll, and reuse signed-in sessions. Output is clean markdown or structured JSON, with fields checked against the source text. Site crawling honors crawl rules and per-domain rate limits, and page change tracking can notify a webhook. Everything retrieved is cached in a local keyword and semantic index on the user's machine, so repeat lookups work offline. Nothing is sent to third parties unless an external language model is explicitly enabled.

Wigolo can be extended with search engine plugins, a proxy and custom certificate authority, and skill packs and setup commands for named coding agents. It installs through several package registries and Docker images, and includes health checks that name any broken component and its fix. Core search, fetch, crawl, extract, and cache features keep working if the optional models or browser fail to install.

## Tags

### Artificial Intelligence & ML

- [Keyless Local Web Search](https://awesome-repositories.com/f/artificial-intelligence-ml/keyless-local-web-search.md) — A locally run Model Context Protocol server that gives AI coding agents web search, page fetching, crawling, and caching with no API keys or cloud accounts. ([source](https://github.com/knockoutez/wigolo#readme))
- [Web Research Agents](https://awesome-repositories.com/f/artificial-intelligence-ml/agent-architectures/ai-agents/research-agents/web-research-agents.md) — Lets agents search many engines in parallel, read pages and gather cited, verifiable evidence for answering questions.
- [Agent Web Search and Page Reading](https://awesome-repositories.com/f/artificial-intelligence-ml/agent-web-search-and-page-reading.md) — Gives coding agents tools to search the web, fetch pages and read their content through MCP, REST or embedded SDKs without API keys.
- [Autonomous Web Research Loops](https://awesome-repositories.com/f/artificial-intelligence-ml/agentic-reasoning-loops/autonomous-web-research-loops.md) — Runs a time-budgeted loop that plans, searches, fetches, extracts, and synthesizes cited answers, logging each step and optionally shaping output to a schema. ([source](https://github.com/knockoutez/wigolo#readme))
- [Autonomous Research Agents](https://awesome-repositories.com/f/artificial-intelligence-ml/autonomous-research-agents.md) — Plans sub-queries, searches, fetches and synthesizes cited answers within a time budget, with a step log and optional schema-shaped output.
- [Verifiable Search Evidence](https://awesome-repositories.com/f/artificial-intelligence-ml/verifiable-search-evidence.md) — Returns each search result with a verbatim excerpt pinned to its source position, a quotable citation ID, and an inspectable score. ([source](https://github.com/knockoutez/wigolo#readme))
- [Agent Tool Server Connections](https://awesome-repositories.com/f/artificial-intelligence-ml/agent-tool-server-connections.md) — Exposes the same web tools through an agent-protocol server, REST endpoint, or embedded SDK so coding agents and apps can call them. ([source](https://github.com/knockoutez/wigolo#readme))
- [Agent Tool Servers](https://awesome-repositories.com/f/artificial-intelligence-ml/agent-tool-servers.md) — Serves the same web tools over MCP, REST with an OpenAPI contract, a command line and typed TypeScript and Python SDKs.
- [Local and On-Device Inference](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning/infrastructure/model-deployment-and-serving/local-and-on-device-inference.md) — Runs the browser engine and the ranking and embedding models on local hardware, removing per-query fees and cloud dependence. ([source](https://github.com/knockoutez/wigolo#readme))
- [Cited Brief Generators](https://awesome-repositories.com/f/artificial-intelligence-ml/research-papers/automated-research-paper-analysis/cited-brief-generators.md) — Breaks a question into sub-queries, fetches many sources, and returns a cited report or structured brief for the host model to write from. ([source](https://github.com/knockoutez/wigolo#readme))
- [Source-Grounded Claim Verifiers](https://awesome-repositories.com/f/artificial-intelligence-ml/source-grounded-claim-verifiers.md) — Returns exact quoted passages pinned to character-position spans in the source page so every claim can be verified against the original text. ([source](https://github.com/knockoutez/wigolo#readme))
- [Web Content Extractions](https://awesome-repositories.com/f/artificial-intelligence-ml/web-content-extractions.md) — Turns pages into clean markdown or structured JSON with tables, metadata and named fields checked against the source text.

### Data & Databases

- [Web Page Markdown Converters](https://awesome-repositories.com/f/data-databases/data-engineering-infrastructure/data-extraction-ingestion/document-processing-tools/llm-powered-parsers/markdown-content-parsers/web-page-markdown-converters.md) — Loads a URL through a tiered router escalating from plain HTTP to a headless browser, returning clean markdown with metadata and links. ([source](https://github.com/knockoutez/wigolo#readme))
- [Offline Search Memory](https://awesome-repositories.com/f/data-databases/offline-search-memory.md) — Stores fetched and searched content locally so repeat queries return instantly and work offline without sending query data to the cloud. ([source](https://github.com/knockoutez/wigolo#readme))
- [Search Result Fusion Algorithms](https://awesome-repositories.com/f/data-databases/search-result-fusion-algorithms.md) — Queries many engines in parallel, merges with rank fusion and reranking, and returns per-result scores with domain, time, phrase, and image filters. ([source](https://github.com/knockoutez/wigolo#readme))
- [Cached Content Search](https://awesome-repositories.com/f/data-databases/cached-content-search.md) — Searches everything already retrieved with keyword or hybrid semantic matching and offers statistics, clearing, and change detection. ([source](https://github.com/knockoutez/wigolo#readme))
- [Web Scraping Result Caches](https://awesome-repositories.com/f/data-databases/data-engineering-infrastructure/caching-performance/caching-strategies/query-result-caching/method-result-caches/web-scraping-result-caches.md) — Stores retrieved page content in a local directory so repeated lookups avoid new network requests and stay private. ([source](https://github.com/knockoutez/wigolo#readme))
- [Web Page Caches](https://awesome-repositories.com/f/data-databases/key-value-stores/response-caching/web-page-caches.md) — Stores fetched pages in a local keyword and vector index so repeat lookups and similarity searches skip refetching from the web. ([source](https://github.com/knockoutez/wigolo#readme))
- [Multi-Page Crawling](https://awesome-repositories.com/f/data-databases/multi-page-crawling.md) — Follows links across a whole site using breadth-first, depth-first, sitemap, or map-only strategies, honoring crawl rules and rate limits. ([source](https://github.com/knockoutez/wigolo#readme))
- [Offline Caching](https://awesome-repositories.com/f/data-databases/offline-caching.md) — Stores every fetched and searched result in a local index on the user's machine so repeat lookups work offline and stay private.
- [Local Web Content Caches](https://awesome-repositories.com/f/data-databases/search-indexing-technologies/search-indexing/search-and-indexing/local-knowledge-base-indexers/local-web-content-caches.md) — Keeps fetched pages in a local keyword and vector index so repeat and similarity lookups run without refetching from the web.
- [Structured Data Extraction](https://awesome-repositories.com/f/data-databases/structured-data-extraction.md) — Extracts tables, metadata, linked data markup, brand identity, and named or custom fields from pages as structured JSON. ([source](https://github.com/knockoutez/wigolo#readme))
- [Breadth-First Site Crawlers](https://awesome-repositories.com/f/data-databases/url-crawl-queues/recursive-crawl-discoverers/breadth-first-site-crawlers.md) — Crawls sites breadth-first, depth-first, by sitemap, or map-only, honoring crawl rules, per-domain rate limits, and boilerplate removal. ([source](https://github.com/knockoutez/wigolo#readme))

### Security & Cryptography

- [Metasearch Engines](https://awesome-repositories.com/f/security-cryptography/privacy-focused-search-engines/metasearch-engines.md) — Queries many public engines in parallel, merges results with rank fusion and reranks on-device with an explainable relevance score.
- [Local-First Private Data Storage](https://awesome-repositories.com/f/security-cryptography/local-first-private-data-storage.md) — Keeps cache, embeddings, models, and configuration on the user's machine and sends nothing to third parties unless an external language model is enabled. ([source](https://github.com/knockoutez/wigolo#readme))

### Web Development

- [Tiered Page Fetching](https://awesome-repositories.com/f/web-development/tiered-page-fetching.md) — Escalates page fetching from plain HTTP to a headless browser on script-rendered, challenge, or thin pages and remembers what each site needs. ([source](https://github.com/knockoutez/wigolo#readme))
- [Blocked Page Detection](https://awesome-repositories.com/f/web-development/blocked-page-detection.md) — Labels stale cache, failed fetches, truncation, and bot-protected pages as failures rather than passing challenge pages off as real content. ([source](https://github.com/knockoutez/wigolo#readme))
- [Web Crawlers](https://awesome-repositories.com/f/web-development/web-crawlers.md) — Fetches pages as clean markdown, escalating from plain HTTP to a headless browser, while honoring crawl rules and per-domain rate limits.
- [Web Page Retrievers](https://awesome-repositories.com/f/web-development/web-page-retrievers.md) — Fetches pages through a tiered ladder from plain HTTP to a headless browser, learning per site and caching results locally. ([source](https://github.com/knockoutez/wigolo#readme))
- [Programmatic Page Interactions](https://awesome-repositories.com/f/web-development/web-page-retrievers/programmatic-page-interactions.md) — Performs clicks, typing, scrolling, and screenshots on live pages and reuses signed-in sessions to reach content behind logins or dynamic interfaces. ([source](https://github.com/knockoutez/wigolo#readme))
- [Site Crawlers and Change Trackers](https://awesome-repositories.com/f/web-development/web-page-retrievers/site-crawlers-and-change-trackers.md) — Crawls sites by breadth-first, depth-first or sitemap strategies with rate limits, and reports page changes to a webhook.

### Part of an Awesome List

- [Search and Research](https://awesome-repositories.com/f/awesome-lists/data/search-and-research.md) — Queries public search engines through direct adapters with on-device reranking and embeddings, so searches cost nothing and need no cloud account. ([source](https://github.com/knockoutez/wigolo#readme))
- [Web Crawling and Scraping](https://awesome-repositories.com/f/awesome-lists/devtools/web-crawling-and-scraping.md) — Crawls public sites like a browser, honoring crawl rules by default and applying per-domain rate limits to keep requests polite. ([source](https://github.com/knockoutez/wigolo#readme))
- [Web Data Ingestion](https://awesome-repositories.com/f/awesome-lists/data/web-data-ingestion.md) — Local-first web intelligence and MCP server for extraction.

### System Administration & Monitoring

- [Result Reliability Flags](https://awesome-repositories.com/f/system-administration-monitoring/result-reliability-flags.md) — Flags junk results with a dedicated scorer, reports failed engines, and labels stale cache so agents know how reliable data is. ([source](https://github.com/knockoutez/wigolo#readme))

### User Interface & Experience

- [Rank Fusion Algorithms](https://awesome-repositories.com/f/user-interface-experience/search-result-ranking/rank-fusion-algorithms.md) — Queries many search engines at once, merges results with rank fusion, and reranks them with an on-device model into an explainable score. ([source](https://github.com/knockoutez/wigolo#readme))
- [Relevance Scoring](https://awesome-repositories.com/f/user-interface-experience/search-result-ranking/relevance-scoring.md) — Breaks each result's relevance score into component factors for inspection and flags weak results as junk. ([source](https://github.com/knockoutez/wigolo#readme))