spyglass-search/spyglassArchived
Spyglass
Spyglass is a local-first information retrieval system designed to aggregate, index, and search personal data and web content. By maintaining a private inverted index on the local device, the platform ensures that all search operations remain functional without an internet connection and that user activity stays entirely private.
The system distinguishes itself through a modular lens architecture, which allows users to apply specific configuration profiles to different data domains or topics. Users can define custom crawling rules to automate the retrieval of web content or import community-curated lenses to immediately query specialized documentation sets and internet sources.
Beyond web-based discovery, the tool functions as a personal knowledge manager by normalizing disparate inputs from local files and remote sources into a unified, searchable library. This pipeline supports offline-first content archiving, ensuring that captured web pages and personal documents remain accessible for future reference regardless of network availability.
Features
- Private Information Retrieval - Provides a private search platform that processes local files and crawled web data for queryable access to personal information.
- Local-First Architectures - Maintains a private inverted index on the local device to ensure search operations remain functional and private without internet access.
- Personal Data Retrieval - Aggregates web content and personal documents into a private, searchable library for offline retrieval.
- Personal Knowledge Management - Organizes and searches through personal collections of local documents and notes to ensure information is always retrievable.
- Personal Knowledge Bases - Organizes and searches across disparate data sources including local files, documentation sets, and community-curated web content.
- Web Page Archiving - Builds a searchable, offline library of web pages and online content to preserve information for future reference.
- Data Aggregation Pipelines - Normalizes disparate inputs from local files and remote web sources into a single searchable format for consistent retrieval.
- Document and Web Content Indexers - Aggregates content from local files, web sources, and third-party services into a unified, searchable index.
- Private Search Indexing - Enables querying the local index to retrieve relevant documents and web content while ensuring all search activity remains private.
- Search Engine Development Tools - Enables the creation of specialized search tools by configuring crawling rules and community lenses to query specific topics.
- Search Lens Architectures - Implements pluggable configuration profiles that define specific indexing parameters and query logic for distinct data domains.
- Offline Web Page Archivers - Captures and persists remote web pages locally to guarantee information remains accessible regardless of network availability.
- Crawler Configuration Managers - Provides declarative configuration rules to automate web content discovery while respecting server constraints.
