1 repository
Allows replacing or customizing underlying synthesis and recognition plugins at runtime.
Distinct from Agent Plugin Frameworks: Focuses on the act of overriding existing plugins to change processing logic, not the general framework for distributing plugins.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Plugin Overriding. Refine with filters or upvote what's useful.
This project is a framework for developing multimodal AI agents that function as programmable participants in real-time communication rooms. It enables the construction of agents that can see, hear, and speak by integrating speech-to-text, large language models, and text-to-speech pipelines to facilitate low-latency, natural conversations. The system is distinguished by its advanced orchestration of real-time media and conversational flow, including support for full-duplex speech, preemptive response generation, and sophisticated interruption management. It further differentiates itself throu
Allows customization of synthesis or recognition plugins to modify an agent's voice or processing logic.