pickle-com/glass

Features

• AI Desktop Assistants - Functions as a desktop-resident AI assistant that analyzes screen content to automate tasks.
• Multimodal Context Processing - Extracts semantic meaning from captured screen and audio buffers using large language models.
• Real-time Context Augmentation - Captures live screen and audio data to provide current, real-time context for LLM prompts.
• Screen-to-LLM Interfaces - Bridges real-time desktop content capture with language models to provide contextual insights.
• Visual Content Analysis - Uses vision models to analyze captured desktop visuals and audio for information extraction.
• Visual Input Captures - Streams real-time visual and auditory desktop data as input for AI perception.
• Global Hotkey Managers - Ships a system-wide keyboard listener to trigger AI queries and actions without window focus.
• AI-Powered Analysis Tools - Analyzes real-time screen and audio captures using large language models for data extraction.
• LLM-Based Semantic Analysis - Processes captured screen and audio information through an LLM to automate data analysis.
• Screen and Audio Capture - Records real-time visual and auditory desktop data to provide context for AI processing.
• Desktop Automation Workflows - Automates desktop-level tasks by triggering AI queries and actions via global hotkeys.
• Global Keyboard Shortcuts - Utilizes system-wide hotkeys to execute application commands and AI queries.
• Action Dispatchers - Provides a system to dispatch OS-level control signals based on analyzed screen content.

Star history