11 repository-uri
Frameworks for building conversational interfaces that integrate speech recognition and language models.
Distinguishing note: Distinct from general chatbots: specifically targets the integration of voice input and output with AI models.
Explore 11 awesome GitHub repositories matching artificial intelligence & ml · Voice-Enabled Agents. Refine with filters or upvote what's useful.
Whisper.cpp is a high-performance, local-first speech recognition engine designed to run large-scale machine learning models on consumer hardware. It functions as a portable library that converts audio into text, supporting both static file transcription and real-time stream processing. By utilizing a lightweight inference engine and weight quantization, the project minimizes memory and compute overhead, allowing for efficient execution without reliance on external cloud APIs or internet connectivity. The project distinguishes itself through a hardware-agnostic compute abstraction that offloa
The project provides the necessary dependencies and linking capabilities to create functional voice-enabled chatbot applications that combine speech-to-text and language models.
Zeroclaw is a modular framework for building and deploying autonomous agents that integrate AI models, messaging platforms, and hardware interfaces. It functions as a multi-agent orchestrator and embedded systems controller, providing a unified runtime for managing agent lifecycles, memory, and security policies across diverse environments. The system distinguishes itself through its focus on secure, verifiable hardware and software orchestration. It enforces strict security boundaries, including command allowlisting, resource throttling, and interactive human-in-the-loop approval for sensiti
Enables telephony and voice-based interactions through SIP, wake-word detection, and outbound speech synthesis.
Voicebox is a local speech processing system that provides text-to-speech generation, speech-to-text transcription, and voice cloning. It utilizes local machine learning inference and GPU acceleration to process audio and text data without relying on external API calls. The project features a voice cloning toolkit for creating synthetic profiles from audio samples and a timeline-based voice editor for composing multi-character conversations. It also includes an AI voice management API that allows external applications and AI agents to programmatically manage voice profiles and generate speech
Provides the ability to link AI agent profiles to specific cloned voice models for natural speech output.
This project is a Python framework for building autonomous, event-driven agent systems. It provides a unified runtime for orchestrating multi-agent workflows, managing persistent conversation state, and executing code within secure, isolated sandbox environments. The framework is designed to handle complex task delegation, allowing agents to invoke other agents as tools while maintaining context across multi-turn interactions. The framework distinguishes itself through its deep integration with the Model Context Protocol, enabling agents to connect to external data sources and remote services
Enables fluid human-computer conversation through voice-enabled agents with integrated context management.
LiveKit is a comprehensive framework for building and orchestrating real-time, multimodal AI agents that interact with users through voice, video, and text. It provides a centralized, event-driven architecture to manage the entire lifecycle of automated participants, from initialization and session state management to graceful shutdown. By utilizing a selective forwarding unit, the platform efficiently routes media streams between participants and agents, ensuring low-latency communication and secure, token-based authentication for all connections. The platform distinguishes itself through it
Provides real-time voice interaction capabilities including preemptive response generation to minimize latency in conversational AI agents.
Xiaogpt is a voice-activated interface and bridge that connects large language models to smart speakers, specifically providing integration for Xiaomi hardware. It functions as a gateway that routes voice queries from hardware microphones to external language model providers and converts the resulting text into audible speech. The system enables the replacement of default smart speaker logic with custom AI models and prompt behaviors. It supports real-time information retrieval by integrating search APIs, allowing the assistant to provide current internet data through spoken responses. The p
Integrates hardware microphones with language model APIs to enable a hands-free conversational voice interface.
Provides a fully local AI companion with speech input, on-device LLM responses, and a Live2D avatar.
This project is a ChatGPT-powered bot integrated into the Feishu chat platform, enabling conversational AI, image generation, and voice interaction within both private and group chats. It connects large language models to the team messaging environment, allowing users to engage in multi-topic conversations, generate images from text prompts, and analyze uploaded images using vision models. The bot supports persona preset switching, allowing predefined role templates to modify the AI's behavior and tone with a single command. It maintains separate conversation histories per topic using session
Transcribes spoken input with Whisper and responds with GPT-4, enabling hands-free dialogue.
Mistral-vibe is an extensible AI skill engine and codebase assistant that operates as an MCP AI agent framework. It functions as a multi-agent orchestration system designed for AI-assisted coding and automated software development, integrating a voice-enabled AI terminal for programmatic interaction. The system distinguishes itself through its use of the Model Context Protocol to integrate external tools and its ability to delegate complex tasks to independent subagents for parallel execution. It features a skill-based extensibility model that allows the addition of custom tools and slash com
Combines voice input capture with a stateful terminal for programmatic AI interaction.
Acest proiect este o interfață web self-hosted și o aplicație desktop concepută pentru interacțiunea cu modelele de limbaj. Oferă o platformă privată pentru gestionarea sesiunilor de conversație, permițând utilizatorilor să se conecteze la servicii AI externe, menținând în același timp controlul asupra istoricului interacțiunilor și a setărilor de configurare. Aplicația se distinge prin oferirea unei interfețe unificate care suportă input-uri și output-uri multimodale, inclusiv procesarea interacțiunii vocale și crearea de imagini generative. Securizează credențialele sensibile prin rutarea cererilor printr-un proxy backend și asigură confidențialitatea datelor prin stocarea jurnalelor de conversație și a istoricului sesiunilor local pe dispozitivul utilizatorului. Dincolo de funcționalitatea de chat de bază, platforma include instrumente pentru streaming-ul în timp real al răspunsurilor, gestionarea istoricului conversațiilor și capacitatea de a exporta jurnale pentru arhivare. Software-ul este împachetat ca un executabil desktop standalone, permițând utilizatorilor să acceseze aceste servicii AI independent de un browser web.
Facilitates hands-free communication with artificial intelligence models through spoken input and audible responses.
This project serves as a curated directory and resource hub for developers working with generative artificial intelligence. It provides a comprehensive index of open-source software solutions, frameworks, and project examples designed to help users discover and implement advanced AI systems. The repository focuses on practical implementations of agentic, multimodal, and retrieval-augmented generation architectures. It highlights tools for building conversational assistants, voice-enabled agents, and automated workflows that leverage large language models. By showcasing diverse technical domai
Connects speech recognition and synthesis services with language models to facilitate natural spoken interactions between users and your software applications.