# pickle-com/glass

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/pickle-com-glass).**

7,537 stars · 1,107 forks · JavaScript · GPL-3.0

## Links

- GitHub: https://github.com/pickle-com/glass
- Homepage: https://pickle.com/glass
- awesome-repositories: https://awesome-repositories.com/repository/pickle-com-glass.md

## Topics

`electron` `local-first` `nextjs` `open-source` `tailwindcss`

## Description

Glass is an AI desktop assistant and screen-to-LLM interface that processes visual and auditory context from a computer to automate tasks. It functions as a tool for screen analysis, bridging real-time desktop captures with large language models to extract semantic meaning and data insights.

The system enables AI-assisted desktop interaction by recording live screen and audio data to provide a persistent digital memory for processing. This allows the application to analyze visible screen information and trigger automation workflows through global keyboard shortcuts.

## Tags

### Development Tools & Productivity

- [AI Desktop Assistants](https://awesome-repositories.com/f/development-tools-productivity/ai-desktop-assistants.md) — Functions as a desktop-resident AI assistant that analyzes screen content to automate tasks.
- [Global Hotkey Managers](https://awesome-repositories.com/f/development-tools-productivity/global-hotkey-managers.md) — Ships a system-wide keyboard listener to trigger AI queries and actions without window focus.
- [AI-Powered Analysis Tools](https://awesome-repositories.com/f/development-tools-productivity/screen-capture-utilities/screen-capture-and-text-extraction/ai-powered-analysis-tools.md) — Analyzes real-time screen and audio captures using large language models for data extraction.
- [LLM-Based Semantic Analysis](https://awesome-repositories.com/f/development-tools-productivity/screen-capture-utilities/screen-capture-and-text-extraction/llm-based-semantic-analysis.md) — Processes captured screen and audio information through an LLM to automate data analysis. ([source](https://cdn.jsdelivr.net/gh/pickle-com/glass@main/README.md))
- [Desktop Automation Workflows](https://awesome-repositories.com/f/development-tools-productivity/development-environment-management/development-environments/desktop-automation-workflows.md) — Automates desktop-level tasks by triggering AI queries and actions via global hotkeys.

### Artificial Intelligence & ML

- [Multimodal Context Processing](https://awesome-repositories.com/f/artificial-intelligence-ml/data-preprocessing-pipelines/llm-context-preparation/multimodal-context-processing.md) — Extracts semantic meaning from captured screen and audio buffers using large language models.
- [Real-time Context Augmentation](https://awesome-repositories.com/f/artificial-intelligence-ml/real-time-context-augmentation.md) — Captures live screen and audio data to provide current, real-time context for LLM prompts.
- [Screen-to-LLM Interfaces](https://awesome-repositories.com/f/artificial-intelligence-ml/screen-to-llm-interfaces.md) — Bridges real-time desktop content capture with language models to provide contextual insights.
- [Visual Content Analysis](https://awesome-repositories.com/f/artificial-intelligence-ml/visual-content-analysis.md) — Uses vision models to analyze captured desktop visuals and audio for information extraction.
- [Visual Input Captures](https://awesome-repositories.com/f/artificial-intelligence-ml/visual-input-captures.md) — Streams real-time visual and auditory desktop data as input for AI perception.

### Graphics & Multimedia

- [Screen and Audio Capture](https://awesome-repositories.com/f/graphics-multimedia/audio-music/audio-recording/screen-and-audio-capture.md) — Records real-time visual and auditory desktop data to provide context for AI processing. ([source](https://cdn.jsdelivr.net/gh/pickle-com/glass@main/README.md))

### Operating Systems & Systems Programming

- [Global Keyboard Shortcuts](https://awesome-repositories.com/f/operating-systems-systems-programming/desktop-environment-frameworks/desktop-environment-components/desktop-application-utilities/global-keyboard-shortcuts.md) — Utilizes system-wide hotkeys to execute application commands and AI queries. ([source](https://cdn.jsdelivr.net/gh/pickle-com/glass@main/README.md))

### User Interface & Experience

- [Action Dispatchers](https://awesome-repositories.com/f/user-interface-experience/action-dispatchers.md) — Provides a system to dispatch OS-level control signals based on analyzed screen content.