11 个仓库
Frameworks for building conversational interfaces that integrate speech recognition and language models.
Distinguishing note: Distinct from general chatbots: specifically targets the integration of voice input and output with AI models.
Explore 11 awesome GitHub repositories matching artificial intelligence & ml · Voice-Enabled Agents. Refine with filters or upvote what's useful.
Whisper.cpp is a high-performance, local-first speech recognition engine designed to run large-scale machine learning models on consumer hardware. It functions as a portable library that converts audio into text, supporting both static file transcription and real-time stream processing. By utilizing a lightweight inference engine and weight quantization, the project minimizes memory and compute overhead, allowing for efficient execution without reliance on external cloud APIs or internet connectivity. The project distinguishes itself through a hardware-agnostic compute abstraction that offloa
The project provides the necessary dependencies and linking capabilities to create functional voice-enabled chatbot applications that combine speech-to-text and language models.
Zeroclaw is a modular framework for building and deploying autonomous agents that integrate AI models, messaging platforms, and hardware interfaces. It functions as a multi-agent orchestrator and embedded systems controller, providing a unified runtime for managing agent lifecycles, memory, and security policies across diverse environments. The system distinguishes itself through its focus on secure, verifiable hardware and software orchestration. It enforces strict security boundaries, including command allowlisting, resource throttling, and interactive human-in-the-loop approval for sensiti
Enables telephony and voice-based interactions through SIP, wake-word detection, and outbound speech synthesis.
Voicebox is a local speech processing system that provides text-to-speech generation, speech-to-text transcription, and voice cloning. It utilizes local machine learning inference and GPU acceleration to process audio and text data without relying on external API calls. The project features a voice cloning toolkit for creating synthetic profiles from audio samples and a timeline-based voice editor for composing multi-character conversations. It also includes an AI voice management API that allows external applications and AI agents to programmatically manage voice profiles and generate speech
Provides the ability to link AI agent profiles to specific cloned voice models for natural speech output.
This project is a Python framework for building autonomous, event-driven agent systems. It provides a unified runtime for orchestrating multi-agent workflows, managing persistent conversation state, and executing code within secure, isolated sandbox environments. The framework is designed to handle complex task delegation, allowing agents to invoke other agents as tools while maintaining context across multi-turn interactions. The framework distinguishes itself through its deep integration with the Model Context Protocol, enabling agents to connect to external data sources and remote services
Enables fluid human-computer conversation through voice-enabled agents with integrated context management.
LiveKit is a comprehensive framework for building and orchestrating real-time, multimodal AI agents that interact with users through voice, video, and text. It provides a centralized, event-driven architecture to manage the entire lifecycle of automated participants, from initialization and session state management to graceful shutdown. By utilizing a selective forwarding unit, the platform efficiently routes media streams between participants and agents, ensuring low-latency communication and secure, token-based authentication for all connections. The platform distinguishes itself through it
Provides real-time voice interaction capabilities including preemptive response generation to minimize latency in conversational AI agents.
Xiaogpt is a voice-activated interface and bridge that connects large language models to smart speakers, specifically providing integration for Xiaomi hardware. It functions as a gateway that routes voice queries from hardware microphones to external language model providers and converts the resulting text into audible speech. The system enables the replacement of default smart speaker logic with custom AI models and prompt behaviors. It supports real-time information retrieval by integrating search APIs, allowing the assistant to provide current internet data through spoken responses. The p
Integrates hardware microphones with language model APIs to enable a hands-free conversational voice interface.
Provides a fully local AI companion with speech input, on-device LLM responses, and a Live2D avatar.
This project is a ChatGPT-powered bot integrated into the Feishu chat platform, enabling conversational AI, image generation, and voice interaction within both private and group chats. It connects large language models to the team messaging environment, allowing users to engage in multi-topic conversations, generate images from text prompts, and analyze uploaded images using vision models. The bot supports persona preset switching, allowing predefined role templates to modify the AI's behavior and tone with a single command. It maintains separate conversation histories per topic using session
Transcribes spoken input with Whisper and responds with GPT-4, enabling hands-free dialogue.
Mistral-vibe is an extensible AI skill engine and codebase assistant that operates as an MCP AI agent framework. It functions as a multi-agent orchestration system designed for AI-assisted coding and automated software development, integrating a voice-enabled AI terminal for programmatic interaction. The system distinguishes itself through its use of the Model Context Protocol to integrate external tools and its ability to delegate complex tasks to independent subagents for parallel execution. It features a skill-based extensibility model that allows the addition of custom tools and slash com
Combines voice input capture with a stateful terminal for programmatic AI interaction.
该项目是一个自托管的 Web 界面和桌面应用程序,专为与语言模型交互而设计。它提供了一个用于管理对话会话的私有平台,允许用户在连接到外部 AI 服务的同时,保持对交互历史和配置设置的控制。 该应用程序通过提供支持多模态输入和输出(包括语音交互处理和生成式图像创建)的统一界面而脱颖而出。它通过后端代理路由请求来保护敏感凭据,并通过将对话日志和会话历史记录本地存储在用户设备上来确保数据隐私。 除了核心聊天功能外,该平台还包括用于实时流式传输响应、对话历史管理以及导出日志以进行归档的功能。该软件被打包为独立的桌面可执行文件,使用户能够独立于 Web 浏览器访问这些 AI 服务。
Facilitates hands-free communication with artificial intelligence models through spoken input and audible responses.
This project serves as a curated directory and resource hub for developers working with generative artificial intelligence. It provides a comprehensive index of open-source software solutions, frameworks, and project examples designed to help users discover and implement advanced AI systems. The repository focuses on practical implementations of agentic, multimodal, and retrieval-augmented generation architectures. It highlights tools for building conversational assistants, voice-enabled agents, and automated workflows that leverage large language models. By showcasing diverse technical domai
Connects speech recognition and synthesis services with language models to facilitate natural spoken interactions between users and your software applications.