hellodigua/ChatLab
ChatLab
ChatLab is a self-hosted chat database and data pipeline designed to normalize, store, and analyze large-scale social conversation histories. It functions as an analytics platform that uses large language models to extract patterns and insights from messaging data imported from multiple platforms.
The system distinguishes itself through an AI-powered analysis engine that utilizes vector-based history analysis and agent-based function calling to summarize conversation trends. It further identifies behavioral patterns by generating visual analytics, including heatmaps, word clouds, and activity rankings.
The platform handles high-volume data ingestion through multi-threaded stream processing and schema-based normalization to convert disparate export formats into a unified data model. It provides a headless API runtime and a command line interface for managing the application lifecycle as a background service.
Users can import conversation records via JSONL batch loading, programmatic ingestion, or scheduled push-pull synchronization.
Features
- Self-Hosted Analytics Platforms - Provides a self-hosted analytics platform that normalizes, stores, and analyzes social conversation histories.
- Chat Query Engines - Uses large language models and agent-based function calling to answer natural-language questions about chat history through SQL translation.
- Local Chat Analysis Agents - Executes AI-powered agents that process chat histories entirely on the user's machine for privacy.
- AI-Powered Data Assistants - Lets natural-language questions be answered by an AI agent that translates them into SQL and returns insights from personal chat data.
- Chat Analysis - Uses large language models to query, summarize, and extract behavioral patterns from personal conversation records.
- Chat History Exporters - Imports chat records from WhatsApp, QQ, LINE, Discord, Instagram, Telegram, and iMessage for local analysis.
- Chat Record Importers - Brings in chat history by dragging a file, connecting an external source for scheduled syncs, or pushing records through a local API.
- Local Chat Processing - Keeps all chat history and analysis on the user's machine, never uploading private conversations to external services.
- SQL Analytics - Runs SQL queries and AI agents on private chat data to uncover trends and insights without sending data to external servers.
- Chat Importers - Parses and normalizes chat exports from WhatsApp, LINE, Telegram, Discord, Instagram, iMessage, and QQ into a consistent format.
- Agent Tool Selection Pipelines - Routes natural-language queries through an AI agent that selects from 24+ tools to search, summarize, and extract insights.
- Vectorized Conversation Analysis - Embeds chat records into vector space to enable similarity search and pattern extraction across large conversation histories.
- Embedded SQL Query Engines - Runs a SQL database entirely on the user's machine, enabling private querying and analysis without external data transfer.
- AI-Enhanced SQL Chat Analyzers - Combines a SQL engine with AI agents to let users query, summarize, and extract patterns from their own messaging data.
- Stream Ingestion - Processes large chat imports by streaming data through multiple worker threads to maintain responsiveness at scale.
- Playlist Importers and Exporters - Parses and normalizes chat exports from seven platforms into a unified model for consistent analysis.
- Chat Data Query APIs - Provides a local REST API for querying, importing, and analyzing chat data from external tools.
- Chat Data Normalizers - Imports and normalizes chat exports from multiple platforms into a unified data model.
- Chat Data Pipelines - Imports, normalizes, and stores chat histories from multiple platforms into a unified local database for analysis.
- Privacy-Preserving Processing - Keeps all chat history and analysis on the user's machine with no cloud upload of raw conversations.
- Local Chat Data Storage - Stores all chat data and settings locally without requiring any cloud upload of raw conversations.
- Chat Data Pipelines - Provides a local-first data pipeline with stream parsing and multi-worker processing for chat history analysis.
- LINE Chat Importers - Imports chat history from LINE using the official chat export feature, accepting a plain text file.
- WhatsApp Chat Importers - Imports chat history from WhatsApp using the official Export Chat feature, accepting a plain text file.
- Headless API Runtimes - Ships a headless REST API runtime for querying, importing, and analyzing chat records from external tools.
- CLI Lifecycle Managers - Operates as a background service with a REST API and command-line interface for managing the application lifecycle.
- Large-Scale Chat Processors - Stream-parses and multi-worker processes chat imports to keep analysis responsive even at million-message scale.
- Large-Scale Local Chat Processors - Uses stream parsing and multi-worker processing to keep imports and analysis responsive even at million-message scale.
- Conversation Heatmaps - Generates heatmaps, word clouds, activity rankings, and trend charts from imported conversation records.
- Telegram Chat Importers - Imports chat history from Telegram using the official desktop export feature, accepting a machine-readable JSON file.
- Chat Trend Visualizers - Displays time patterns, interaction frequency, word clouds, and activity rankings from imported conversation histories.
- iMessage Chat Importers - Imports chat history from iMessage on macOS using a dedicated export tool that produces a standard JSON file.
- Instagram Chat Importers - Imports chat history from Instagram using the official data download feature, accepting a JSON file.
- Discord Chat Importers - Imports chat history from Discord using a JSON file exported by the DiscordChatExporter tool.
