Projects sharing features with Harmony

BAML is a prompt engineering framework and LLM client generator that defines AI prompts as type-safe functions. It serves as a structured data extraction tool and workflow orchestrator, transforming unstructured model responses into strongly typed objects using a custom schema language and alignment algorithms. The project distinguishes itself by using a compiler to generate language-specific boilerplate code for API communication and output parsing. It features a dedicated environment for designing complex prompt templates with conditional logic and reusable snippets, and employs genetic alg

Eino is an AI agent development kit and LLM application framework designed for building autonomous agents and orchestrating complex language model workflows. It serves as a multi-agent orchestration engine and workflow orchestrator, providing a graph-based execution model to route data between models, tools, and retrievers. The framework distinguishes itself through a robust set of multi-agent coordination patterns, including supervisor-led management, sequential flows, and autonomous reasoning loops like ReAct. It features advanced agent execution controls such as active turn preemption, che

This project is a structured educational resource and technical guide for designing and implementing autonomous systems using large language models. It provides a comprehensive curriculum and code samples focused on agentic design patterns, autonomous development, and the creation of systems capable of planning and executing multi-step tasks. The resource details the implementation of agentic retrieval-augmented generation, where models autonomously plan and refine data searches. It covers a wide array of orchestrators and design patterns, including metacognitive reflection for self-correctin

Pipecat is a framework and software development kit for building real-time multimodal AI agents and speech-to-speech systems. It utilizes a frame-based data pipeline to route audio, video, and text through a modular sequence of processors, enabling the orchestration of low-latency conversational AI. The project is distinguished by its ability to coordinate complex multimodal services, including speech-to-text, language models, and text-to-speech, within a single pipeline. It features semantic voice activity detection for natural turn-taking, state-machine conversation flows for dialogue manag

The Gemini Cookbook is a comprehensive collection of implementation patterns, code samples, and development guides designed for building applications with Google Gemini models. It serves as a central resource for developers to integrate multimodal generative artificial intelligence into their software, providing the necessary frameworks to manage model interactions, stateful workflows, and structured data extraction. The repository distinguishes itself by offering specialized toolkits for autonomous agent orchestration, enabling the construction of agents that can execute code, browse the web

Vercel is a cloud platform for building, deploying, and scaling web applications. It provides a unified infrastructure that automates the build process by detecting project frameworks and distributing static and dynamic content through a global content delivery network. The platform executes application logic using serverless functions that scale automatically based on real-time traffic demand. The platform distinguishes itself through a centralized AI gateway that proxies requests to multiple model providers, enabling standardized authentication, observability, and cost tracking. It supports

Instructor is a library designed to parse, validate, and map unstructured language model responses into strongly typed, schema-compliant data objects. It provides a framework for structured data extraction that uses data modeling classes to enforce strict type constraints on model outputs, ensuring that generated content consistently matches expected structures. The library distinguishes itself through an automated error recovery system that manages the lifecycle of failed extraction attempts. When a model output fails to meet defined schema requirements, the framework automatically triggers

The inspector is a diagnostic and validation tool for the Model Context Protocol. It provides an interactive interface and a transport proxy to discover, inspect, and execute the tools, prompts, and resources provided by an MCP server. The project serves as a debugger and compliance tester to verify that server implementations adhere to the protocol specification and JSON-RPC standards. It allows for real-time monitoring of message exchanges and logs between clients and servers across various transport layers, such as standard input/output and Server-Sent Events. The tool covers a broad rang

This is a Python SDK for interacting with large language models via API. It serves as a client library to generate text, process messages, and manage conversational states, while providing a specialized interface for connecting to models hosted across different cloud infrastructure providers. The SDK includes a tool-calling framework that maps Python functions to JSON schemas, allowing models to execute external tools. It also features a built-in token counting utility to estimate input size before transmission and a server-sent events client for receiving model tokens in real time. The libr

gptel is an LLM Emacs client and multi-backend AI integration system that allows users to interact with large language models directly inside the Emacs text editor. It serves as an AI-powered text refactoring tool and a context-aware prompt manager, providing a unified interface to connect with various AI providers, including local Ollama instances, AWS Bedrock, and Gemini. The project distinguishes itself as a Model Context Protocol client, connecting to MCP servers to provide language models with external tools and data sources. It enables context-augmented prompting by aggregating text fro

AG2 is a multi-agent large language model orchestration framework, agentic workflow automation tool, and RAG-enabled agent platform. It functions as a communication protocol and framework for coordinating multiple AI agents to solve complex tasks through shared state and standardized messaging. The project distinguishes itself through flexible coordination strategies, including hierarchical agent organization, hub-and-spoke models, and dynamic routing that analyzes conversation context to distribute work. It implements multi-stage feedback loops for iterative refinement and uses schema-constr

fastmcp is a Python library and framework for building servers and clients that implement the Model Context Protocol. It serves as a tool integration library designed to connect large language models to external tools and data sources. The framework features an interactive tool user interface renderer, which allows for the display of visual interfaces for tools directly within a conversational flow. It also provides a library for automatically generating schemas and validation for tools used by language models. The project covers server and client development, including tool and resource exp

This project provides a collection of reference implementations, architectural patterns, and SDK samples for building autonomous agents using large language models. It serves as a multi-language framework for implementing and deploying specialized AI agents across diverse programming environments. The system centers on an orchestration framework that combines deterministic code with adaptive reasoning through structured graph workflows. It utilizes schema-driven integration to connect agents with third-party applications and diverse AI models. The development lifecycle is supported by toolki

CrewAI is a multi-agent orchestration framework and autonomous agent workflow engine. It provides a system for coordinating autonomous AI agents with specific roles and goals to solve complex tasks through collaborative intelligence. The framework distinguishes itself through a collaborative AI agent system that enables multiple language model instances to share intelligence and execute multi-step objectives via role-playing. It incorporates human-in-the-loop mechanisms, allowing for manual review checkpoints to validate decisions and refine outcomes within autonomous execution paths. The pl

Langroid is a multi-agent orchestration framework and tool integration suite designed for building complex AI applications. It serves as a multi-modal integration layer that connects diverse local and remote language models with an agentic retrieval-augmented generation system. The project distinguishes itself through a collaborative message-exchange paradigm, allowing specialized agents to delegate tasks hierarchically and coordinate via structured communication. It features an advanced state management system for conversational AI, including the ability to rewind and prune conversation hist

GLaDOS is a multimodal AI agent framework designed to create autonomous systems that process text, speech, and visual data to interact with users and their environment. It centers on an AI personality framework that emulates complex character personas using a multi-agent architecture and configurable behavioral profiles. The project distinguishes itself through an integrated tool layer that connects language models to external hardware, smart home devices, and system APIs via a standardized protocol. It features a character text-to-speech engine with low-latency playback and interruption hand

DeepSeek-TUI is an AI coding agent orchestrator and framework designed to automate complex programming tasks. It functions as a harness for coordinating AI models that can read source code, edit files, and execute shell commands through automated agent workflows. The system is distinguished by its multi-agent coordination capabilities, which allow for the spawning of parallel sub-agents to handle concurrent investigations or implementation slices. It employs autonomous goal-seeking loops to pursue objectives across multiple turns and utilizes a tool integration gateway to connect models to ex

This project is a Java-based framework integration that provides an AI agent runtime, a graph-based AI workflow engine, and an LLM orchestration framework for Spring applications. It enables the development of stateful autonomous agents and the implementation of retrieval-augmented generation systems using document processing and vector databases. The framework distinguishes itself through a graph-based workflow runtime for designing complex AI pipelines with conditional routing and persistent state. It supports multi-agent orchestration via service-discovery coordination and provides human-i

This project is an AI engineering cookbook and tutorial suite providing step-by-step patterns for building production-ready artificial intelligence systems. It serves as an implementation guide and framework for integrating large language models into software applications. The repository functions as a generative AI pattern library, offering curated code snippets and modular scripts to connect models to external data and tools. It provides a collection of practical examples and reusable implementation patterns designed to accelerate the development of AI features and prototypes. The codebase

Agent Squad is an LLM multi-agent orchestration framework designed to coordinate specialized agents to solve complex tasks. It functions as a system for managing agent teams and supervisors, utilizing a supervisor-led orchestration model to decompose large problems into manageable steps. The framework distinguishes itself through a combination of intent-based query routing and human-in-the-loop automation. It employs a hierarchical routing system to direct requests to the most appropriate agent or model, while integrating asynchronous messaging queues to route complex cases to human operators

This project is a software development kit and framework for building AI agent orchestration, session management, and tool integration systems. It provides a backend infrastructure for hosting remote AI sessions and coordinating multi-agent workflows using large language models. The SDK enables the definition of specialized agents and the orchestration of complex tasks through parallel workstreams. It distinguishes itself by offering a multi-tenant backend capable of horizontal scaling and a headless server runtime that separates session execution from the client interface. The system covers

adk-go is an agent orchestration engine and multi-agent framework for building, coordinating, and scaling systems of large language model agents. It provides a tool integration kit to connect agents with external APIs, custom functions, and diverse data sources. The project utilizes graph-based workflow orchestration to blend deterministic logic with adaptive reasoning. It supports modular multi-agent composition, allowing specialized agents to be organized into hierarchical structures to manage complex tasks through coordinated workflows. The framework includes tools for performance evaluat

Koog is an LLM agent framework used to build autonomous entities that execute tool-based workflows. It utilizes a graph-based workflow engine to define agent behaviors and decision paths as a directed graph of nodes and edges. The framework distinguishes itself through a model provider orchestrator that enables dynamic switching, load balancing, and automatic fallbacks between different AI backends. It implements the Model Context Protocol to connect agents to remote tool servers and features a RAG memory system using vector embeddings to maintain long-term conversation context. The project

Agent Zero is an LLM agent framework and multi-agent orchestrator that provides an AI-powered interface for operating system tasks. It functions as a containerized AI workspace, allowing large language models to interact with a filesystem and terminal within an isolated Linux environment. The system distinguishes itself through a hierarchical orchestration model that decomposes complex goals by spawning specialized sub-agents to collaborate and consolidate results. It features a plugin-based architecture for extending capabilities via a community plugin hub, a custom skills system, and extern

Openwork is an AI agent for desktop automation that uses large language models to execute browser tasks, manage local files, and automate desktop workflows. It operates on a local-first execution model, translating natural language prompts into sequences of tool calls to perform digital chores. The system functions as a framework for defining and saving repeatable sequences of actions as reusable skills. It integrates large language models with third-party services and local APIs to synchronize data and share files. The agent includes capabilities for headless browser automation to conduct r

Astron-agent is an orchestration platform for designing and executing complex agentic workflows that combine language models with external tools and business systems. It provides a production-ready environment for deploying AI services within private intranets using container orchestration for scalable management. The platform distinguishes itself by linking large language model decision-making with robotic process automation to execute tasks across enterprise applications. It further supports enterprise requirements through a multi-tenant infrastructure that utilizes isolated memory and iden

OpenGPTs is a platform for building, deploying, and managing customizable AI assistants. It serves as an orchestrator that allows for the configuration of large language models with specific personas, cognitive architectures, and tool integrations. The system provides a complete lifecycle manager for AI agents, enabling the drafting of configurations, testing within sandboxes, and publishing assistants for public or internal distribution. It integrates a knowledge base interface using retrieval-augmented generation to attach documents to bots for context-aware responses. The platform covers