bitmagnet-io/bitmagnet
Bitmagnet
Bitmagnet is a self-hosted BitTorrent metadata search engine and DHT torrent indexer. It functions as a private torrent database that crawls the Distributed Hash Table to discover and index content locally without relying on centralized trackers.
The system distinguishes itself through an automated media classification pipeline that fetches information from external databases to tag and categorize content. It employs a rule-based classification engine and custom workflows to determine how indexed items are processed and organized.
The project provides full-text search capabilities and multi-source data ingestion, supported by a background queue for metadata enrichment. Administrative control is handled via a web dashboard, while programmatic access is available through GraphQL and standardized HTTP interfaces. The system also includes telemetry via Prometheus metrics export and state persistence through index backups and exports.
Features
- BitTorrent Indexers - Provides a complete system for crawling, indexing, and searching BitTorrent metadata from the DHT network.
- Content Metadata Enrichment - Automatically resolves and attaches detailed information from external databases to enhance torrent discoverability.
- Media Content Classifiers - Implements an automated pipeline that fetches external data to categorize and tag indexed media content.
- Conditional Classification Workflows - Allows the creation of custom conditional action sequences to determine how torrents are processed and categorized.
- Full-Text Search Indexes - Stores discovered torrent metadata in a searchable database to enable fast keyword-based lookups.
- Full Text Search - Provides text-based lookups across the indexed torrent collection to find specific content.
- Private Torrent Databases - Provides a private, self-hosted database for storing and organizing discovered torrent data.
- DHT Network Crawlers - Discovers unique identifiers from the DHT network and requests metadata directly from peers.
- Filename-Based Media Classification - Fetches metadata from external services to identify and categorize torrents based on their filenames.
- DHT Crawlers - Crawls the Distributed Hash Table to discover and index torrent metadata locally.
- Peer-to-Peer Clients - Implements a BitTorrent-specific DHT crawler for peer discovery and metadata retrieval.
- Rule-Based Classification Engines - Employs a rule-based engine to determine item categories and tags using conditional logic and keyword filters.
- Content Metadata Tagging - Assigns custom metadata tags to torrents matching specific criteria for user-defined organization.
- Asynchronous Processing Queues - Utilizes a background worker queue to resolve and attach detailed information from external databases.
- Media Content Filters - Removes items from the index based on banned keywords, specific content types, or custom rules.
- Media Automation Tools - Integrates with external management tools to automate the discovery and downloading of media content.
- Data Ingestion Sources - Ingests torrent metadata from both distributed network sources and external import files.
- Metadata Reclassification Pipelines - Refines metadata records by matching items against local tables or external services.
- Self-Hosted Administration Interfaces - Provides a web-based administration interface for managing the private indexing service, monitoring health, and performing backups.
- REST API Interfaces - Provides a standardized REST-based HTTP interface for external tool communication and system management.
- Torrent Indexer API Implementations - Implements the Torznab API standard to ensure compatibility with third-party torrent managers and automation tools.
- Administrative Dashboards - Provides a responsive web dashboard for monitoring operational status and performing administrative tasks.
- GraphQL APIs - Provides a structured GraphQL API for programmatically retrieving data and managing the index.
- Download Managers - Self-hosted indexer and crawler for BitTorrent content.
