# moeru-ai/airi

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/moeru-ai-airi).**

17,516 stars · 1,711 forks · TypeScript · mit

## Links

- GitHub: https://github.com/moeru-ai/airi
- Homepage: https://airi.moeru.ai/docs/
- awesome-repositories: https://awesome-repositories.com/repository/moeru-ai-airi.md

## Topics

`ai-companion` `ai-vtuber` `clawdbot` `digital-life` `grok-companion` `live2d` `moltbot` `neuro-sama` `neurosama` `vrm` `vtuber`

## Description

Airi is an interactive digital companion engine designed to bridge large language models with local animation rendering. It functions as a middleware platform that synchronizes conversational text streams with skeletal and facial movements to drive virtual avatars in real time.

The framework distinguishes itself by integrating desktop context awareness, allowing characters to maintain situational awareness of a user's screen activity across both desktop and web environments. It utilizes a hybrid execution model that splits computational workloads between cloud-based language processing and local client-side rendering to facilitate responsive, low-latency interactions.

The system manages character behavior through a modular state machine that maps emotional tokens from language models to specific animation clips. It supports bidirectional event streaming to coordinate concurrent tasks, including audio synthesis, lip-sync generation, and character movement.

## Tags

### Artificial Intelligence & ML

- [Conversational AI Agents](https://awesome-repositories.com/f/artificial-intelligence-ml/agentic-systems-frameworks/conversational-voice-interaction/conversational-ai-agents.md) — Integrates large language models into applications to enable natural, real-time spoken or text-based interactions with virtual characters.
- [Facial Animation](https://awesome-repositories.com/f/artificial-intelligence-ml/facial-animation.md) — Drives character movements and facial expressions in real time by connecting large language models to animation software.
- [Hybrid Execution Engines](https://awesome-repositories.com/f/artificial-intelligence-ml/local-model-execution/hybrid-execution-engines.md) — Splits computational workloads between cloud-based language processing and local client-side rendering to minimize latency.

### Business & Productivity Software

- [Interactive Desktop Companions](https://awesome-repositories.com/f/business-productivity-software/desktop-personalization-tools/interactive-desktop-companions.md) — Develops interactive characters that communicate in real time while maintaining awareness of the user screen. ([source](https://airi.moeru.ai/docs/en/docs/overview/about-ai-vtuber))

### Graphics & Multimedia

- [Conversational Animation Middleware](https://awesome-repositories.com/f/graphics-multimedia/media-production-suites/animation-tools/programmatic-animation-apis/animation-timing-utilities/conversational-animation-middleware.md) — Synchronizes speech with facial expressions and body gestures by bridging conversational AI models with local animation rendering engines.
- [LLM-Driven Motion Synthesizers](https://awesome-repositories.com/f/graphics-multimedia/mesh-processing-apis/skeletal-animation/llm-driven-motion-synthesizers.md) — Translates conversational text streams into synchronized skeletal and facial animation data using real-time inference.

### User Interface & Experience

- [LLM-Driven Avatar Frameworks](https://awesome-repositories.com/f/user-interface-experience/avatars/llm-driven-avatar-frameworks.md) — Connects large language models to animation software to drive real-time character expressions and movements.
- [Conversational Avatar Animators](https://awesome-repositories.com/f/user-interface-experience/keyboard-input-visualizers/input-reactive-character-animators/conversational-avatar-animators.md) — Syncs large language models with animation software to drive character movements and facial expressions based on real-time conversational input. ([source](https://airi.moeru.ai/docs/en/docs/overview/about-neuro-sama))
- [Behavioral State Machines](https://awesome-repositories.com/f/user-interface-experience/animation-and-motion-systems/configuration-utility-helpers/animation-configuration/playback-lifecycle-controllers/animation-state-management/behavioral-state-machines.md) — Manages character behavior transitions by mapping discrete emotional tokens from the language model to predefined animation clips.

### Software Engineering & Architecture

- [Visual Context Awareness Engines](https://awesome-repositories.com/f/software-engineering-architecture/context-aware-tooling/visual-context-awareness-engines.md) — Extracts visual metadata from the user environment to provide language models with situational awareness of the active desktop.
- [Asynchronous Task Orchestration](https://awesome-repositories.com/f/software-engineering-architecture/asynchronous-task-orchestration.md) — Coordinates concurrent audio, lip-sync, and animation tasks to ensure fluid real-time character interaction.

### Development Tools & Productivity

- [Desktop Context Extractors](https://awesome-repositories.com/f/development-tools-productivity/screen-capture-utilities/desktop-context-extractors.md) — Extracts visual metadata from the user environment to provide language models with situational awareness.

### Networking & Communication

- [Real-Time Interaction Engines](https://awesome-repositories.com/f/networking-communication/websocket-clients/real-time-interaction-engines.md) — Maintains low-latency bidirectional communication between the language model backend and the local character rendering client.
- [WebSocket Event Systems](https://awesome-repositories.com/f/networking-communication/distributed-systems-p2p/distributed-computing/communication-protocols/websocket-implementations/websocket-event-systems.md) — Maintains low-latency bidirectional communication between the language model backend and the local animation rendering client.

### Web Development

- [Cross-Platform Interaction Frameworks](https://awesome-repositories.com/f/web-development/cross-platform-desktop-frameworks/cross-platform-interaction-frameworks.md) — Builds interactive virtual entities that function seamlessly across both desktop and web environments.