Projects sharing features with Openai Realtime Agents

LiveKit is a comprehensive framework for building and orchestrating real-time, multimodal AI agents that interact with users through voice, video, and text. It provides a centralized, event-driven architecture to manage the entire lifecycle of automated participants, from initialization and session state management to graceful shutdown. By utilizing a selective forwarding unit, the platform efficiently routes media streams between participants and agents, ensuring low-latency communication and secure, token-based authentication for all connections. The platform distinguishes itself through it

Openclaw is a platform for managing agent execution environments, providing the infrastructure to control agent lifecycles, session state, and workspace persistence. It features a centralized gateway that handles model loops, tool invocation, and streaming events, while supporting multi-agent routing and persistent memory management. The system is designed to normalize tool execution signatures and provide a standardized interface for cross-provider compatibility. The platform includes extensive developer tooling, such as a command-line interface for workspace management, diagnostic logging,

Nexent is an enterprise AI control plane and LLM agent orchestration platform. It provides a zero-code environment for designing, deploying, and managing production AI agents through a multi-agent collaboration framework that coordinates specialized autonomous agents using standardized messaging protocols. The platform integrates the Model Context Protocol to connect agents with external tools, plugins, and services via a universal communication interface. It further distinguishes itself with a dedicated RAG knowledge base manager that imports unstructured documents and utilizes hybrid search

Swarm is a framework for building conversational systems that coordinate multi-agent workflows. It functions as an orchestration engine that manages persistent, multi-turn dialogues by routing tasks between specialized agents and executing local functions. The system is designed to handle complex, multi-step processes by maintaining shared state and context across agent interactions. The framework distinguishes itself through its approach to dynamic task delegation and execution control. It enables agents to hand off tasks to one another by returning agent objects, allowing for modular, domai

Agentscope is a comprehensive toolkit for developing and orchestrating autonomous multi-agent systems. It provides a unified framework for building agents that can reason, execute tools, and manage memory, enabling the creation of complex, collaborative workflows where multiple specialized agents interact to solve multi-step objectives. The platform distinguishes itself through a robust orchestration engine that supports both sequential and concurrent agent pipelines. It utilizes a centralized event bus for real-time telemetry, allowing developers to track agent reasoning, tool usage, and sys

This is an open-source Python SDK for building and orchestrating production-grade AI agents. It provides a unified framework for creating conversational agents that can use tools, maintain state, and coordinate across multiple language model providers including OpenAI, Anthropic, Google, Amazon Bedrock, and locally-hosted models. The SDK supports multi-agent orchestration through graphs, teams, and swarms, allowing several specialized agents to collaborate on complex tasks. Agents can be composed as callable tools that other agents invoke, and the framework includes policy handlers that inspe

This project is a conversational AI software development kit and framework used to build interactive chatbots that engage in natural language conversations and execute tasks for end users. It provides a multi-channel bot framework that connects conversational agents to various external messaging services using standardized adapters. The SDK includes a conversational workflow orchestrator and a natural language processing toolkit for analyzing user intent and extracting entities to route conversation flows. It further incorporates a speech integration framework that enables bidirectional audio

This project is a Python framework for building autonomous, event-driven agent systems. It provides a unified runtime for orchestrating multi-agent workflows, managing persistent conversation state, and executing code within secure, isolated sandbox environments. The framework is designed to handle complex task delegation, allowing agents to invoke other agents as tools while maintaining context across multi-turn interactions. The framework distinguishes itself through its deep integration with the Model Context Protocol, enabling agents to connect to external data sources and remote services

Ruflo is an AI agent orchestration platform and workflow automation tool designed to decompose high-level goals into executable action plans. It functions as a manager for multi-agent swarms, organizing autonomous entities into collaborative topologies that utilize shared consensus to complete complex tasks. The framework distinguishes itself through a retrieval-augmented generation layer and knowledge graphs for reasoning over linked data. It incorporates a trajectory-based learning loop that analyzes previous execution paths to refine cognitive patterns and improve future reasoning accuracy

Duix-Mobile is a software development kit for deploying real-time conversational AI characters on mobile devices. It enables the creation of interactive digital humans capable of fluid voice-to-voice interactions, featuring low-latency speech recognition and synchronized lip movements. The project distinguishes itself through the ability to integrate custom external language models and speech providers to define an avatar's intelligence and voice. It supports the generation of real-time multilingual subtitles and provides mechanisms to track the training status of newly created digital charac

AIOS is an LLM agent operating system and orchestration kernel designed to manage memory, resource scheduling, and tool execution for multiple autonomous AI agents. It serves as a comprehensive framework for developing and deploying agents, featuring a dedicated resource manager that coordinates model backends, GPU memory, and isolated kernel instances. The system distinguishes itself through a semantic memory engine that uses vector search and autonomous clustering for long-term knowledge management, and a semantic file system that allows users to control computer files and system operations

This project is a framework for building AI coding agents that automate software development tasks using large language models. It includes a task lifecycle manager that tracks complex development goals through a persistent graph of dependent tasks and a system for multi-agent orchestration to delegate tasks to specialized sub-agents. The framework implements a Model Context Protocol client to discover and execute tools from external servers and provides a remote development bridge to synchronize local command line interfaces with remote containers or desktop environments. The system covers

Owl is a framework for agentic workflow automation and multi-agent orchestration. It functions as a system for coordinating autonomous large language model agents to decompose and execute complex tasks through shared communication and collaborative planning. The project distinguishes itself through a multi-modal toolset for processing images, audio, and video, alongside a synthetic data generator that produces domain-specific datasets using self-instruct and verifier loops. It further incorporates a retrieval-augmented generation pipeline framework that integrates long-term memory and real-ti

ROMA is an agentic workflow engine and recursive task orchestrator designed to coordinate autonomous agents in the execution of complex workflows. It functions as a multi-agent framework that decomposes high-level goals into atomic subtasks and manages their execution through a dependency graph. The system distinguishes itself through a hierarchical plan-execute loop that recursively decomposes objectives and synthesizes results from leaf-node tasks upward. It ensures execution purity via atomic task isolation, assigning dedicated storage directories to individual tasks to prevent data interf

Open Multi-Agent is a TypeScript framework for multi-agent orchestration that decomposes natural language goals into a runtime-generated directed acyclic graph of tasks. It functions as a task orchestrator and workflow state manager, coordinating multiple AI models to execute parallel and sequential operations. The framework is distinguished by a proposer-judge consensus protocol used to validate agent outputs through a quorum of agreement. It employs provider-agnostic model routing to assign specific models to tasks based on roles or execution phases and utilizes state-based workflow checkpo

🎙️🤖Create, Customize and Talk to your AI Character/Companion in Realtime (All in One Codebase!). Have a natural seamless conversation with AI everywhere (mobile, web and terminal) using LLM OpenAI GPT3.5/4, Anthropic Claude2, Chroma Vector DB, Whisper Speech2Text, ElevenLabs Text2Speech🎙️🤖

Moshi is a real-time voice foundation model and speech-to-speech framework designed for bidirectional, low-latency conversations. It functions as a full-duplex voice interface that processes audio and text concurrently in a single stream, enabling natural human-machine dialogue without sequential processing delays. The system utilizes a neural audio codec to compress high-fidelity audio into low-bitrate tokens for efficient transmission. To manage complex responses and reasoning, it employs internal monologue modeling, which generates a hidden stream of thought tokens alongside audible speech

AgenticSeek is a multi-agent orchestration system designed to decompose complex user objectives into granular, actionable tasks. By coordinating a team of specialized autonomous workers, the platform manages end-to-end workflows, ensuring that each component of a project is assigned to the most capable agent for execution. The system operates as a local-first runtime, executing all artificial intelligence models directly on user hardware to maintain data sovereignty and privacy. It integrates a browser automation engine for autonomous web research and interaction, alongside a sandboxed enviro

Eigent is a comprehensive platform for developing, configuring, and orchestrating autonomous AI agents. It functions as an agent development environment and workflow automation engine, enabling users to build modular agents equipped with custom toolsets, domain-specific skill packages, and external API connections to perform targeted operational tasks. The framework distinguishes itself through a robust multi-agent orchestration layer that coordinates teams of specialized agents to execute complex workflows. By utilizing hierarchical task decomposition, the system breaks high-level goals into

This project provides a framework for managing multi-agent systems, designed to automate complex software development, infrastructure, and business workflows. It functions as a multi-agent workflow orchestrator that routes tasks to domain-specific workers while maintaining state persistence and infrastructure automation. By leveraging large language models, the system decomposes high-level objectives into actionable plans, ensuring that complex operations are executed with consistency and reliability. The framework distinguishes itself through its hierarchical agent registry and policy-driven

Mastra is an orchestration framework designed for building, deploying, and managing autonomous AI agents and multi-agent systems. It provides a comprehensive suite of primitives for creating resilient AI applications, including durable workflow orchestration, event-driven agent loops, and semantic memory management. By integrating these core components, the platform enables developers to build complex, multi-step processes that can reason about goals and execute tasks without manual intervention. The framework distinguishes itself through its focus on observability and secure, isolated execut

This framework provides a development environment for building collaborative systems where autonomous agents interact to solve complex tasks through conversational workflows. It functions as a conversational workflow engine and event-driven runtime, coordinating multi-step processes by translating high-level goals into structured dialogue sequences between specialized agents. The system distinguishes itself through its message-passing orchestration, which manages state transitions and task delegation between independent participants. It supports dynamic conversation state management to provid

GenAI_Agents is a development framework and orchestration engine designed for building autonomous, multi-agent systems. It provides the infrastructure to construct complex, state-managed workflows where specialized agents collaborate to execute multi-step tasks, manage long-term memory, and perform iterative reasoning. The platform distinguishes itself through its graph-based orchestration model, which allows developers to define intricate agentic processes with explicit state transitions. It supports advanced control mechanisms such as human-in-the-loop intervention for manual oversight and

PentestGPT is an autonomous security testing framework that leverages large language models to plan, execute, and coordinate end-to-end penetration testing engagements. By functioning as an autonomous agent, the system automates the entire testing lifecycle, from initial reconnaissance and vulnerability analysis to the generation of custom exploits and the execution of post-exploitation tasks. The platform distinguishes itself through a multi-agent orchestration system that coordinates specialized AI agents to collaborate on complex, multi-stage attack chains. It integrates multimodal context

Atmosphere is a Java-based framework for building and coordinating AI agents. It provides a real-time transport layer for streaming data via WebSockets, SSE, gRPC, and WebTransport, alongside a multi-agent orchestration framework for managing agent fleets through sequential, parallel, and graph-based execution workflows. The project features a durable workflow engine that persists agent state as snapshots, allowing long-running tasks to survive system restarts and incorporate human-in-the-loop approvals. It also implements Model Context Protocol servers to expose tools, resources, and prompt

Mimiclaw is a framework for integrating large language models with microcontroller hardware to create interactive AI agents. It provides an embedded AI agent runtime and a tool-calling engine that allows language model loops to execute on embedded devices. The system acts as a bridge between language model APIs and physical hardware peripherals, enabling the control of sensors and actuators through natural language. The project features a dedicated manager for over-the-air firmware updates, allowing system images to be installed via web browsers or wireless networks to remove local toolchain

This project is an LLM financial agent framework and multi-agent orchestration system designed to execute complex investment banking and wealth management workflows. It provides a financial data integration layer using a standardized context protocol to connect autonomous agents to real-time market data and third-party feeds. The system utilizes a multi-agent architecture that coordinates specialized worker agents through a steering event bus to handle task delegation and secure handoffs. It includes an enterprise AI deployment manifest for provisioning agent personas, prompts, and skill sets