Open-source alternatives to TaskWeaver

The agent-framework is an LLM agent orchestration framework and multi-agent workflow engine designed for building autonomous AI agents. It provides a tool integration layer for binding external functions, APIs, and sandboxed code as executable tools for language models. The framework distinguishes itself through a graph-based system for designing sequential and parallel task flows, featuring state management and checkpointing for long-running processes. It implements comprehensive conversational state management and an observability suite that uses telemetry to trace execution flows and monit

BAML is a prompt engineering framework and LLM client generator that defines AI prompts as type-safe functions. It serves as a structured data extraction tool and workflow orchestrator, transforming unstructured model responses into strongly typed objects using a custom schema language and alignment algorithms. The project distinguishes itself by using a compiler to generate language-specific boilerplate code for API communication and output parsing. It features a dedicated environment for designing complex prompt templates with conditional logic and reusable snippets, and employs genetic alg

This project is a WeChat LLM bot framework and messaging gateway designed to connect WeChat accounts to language models for automated responses and group chat interactions. It functions as an orchestration layer that routes incoming messages to AI agents and returns generated responses to users. The system distinguishes itself through a provider-agnostic routing mechanism that distributes messages across various cloud-based and local language model services. It includes a command-line interface for managing login sessions, searching chat history, and sending messages, as well as a whitelist-b

Agency Swarm is a multi-agent orchestration framework and development kit designed to coordinate specialized AI agents through defined communication patterns and handoffs. It functions as a system for managing agent swarms, providing an API gateway to expose these coordinated collectives as production-ready HTTP endpoints. The project distinguishes itself through its Model Context Protocol integration layer, which connects agents to external data sources and capabilities. It implements specialized orchestration patterns, such as the orchestrator-worker model and role-based delegation, to tran

Kilocode is an autonomous engineering platform designed to orchestrate AI agents for complex software development tasks. It functions as a comprehensive system for automating coding, testing, and repository management by integrating directly with your codebase and terminal. The platform provides a unified gateway for model orchestration, allowing for the management of agentic workflows, event-driven automation, and persistent session state across distributed development environments. The platform distinguishes itself through its federated task management and policy-based access control, which

Awesome Copilot is a comprehensive framework for autonomous software development, providing the infrastructure to orchestrate multi-agent teams and automate complex coding workflows. It functions as a centralized platform for managing AI-driven development, enabling developers to deploy specialized agents that interact with local files, terminal commands, and external APIs to execute end-to-end software delivery tasks. The project distinguishes itself through its focus on governance and extensibility, offering a suite of security controls, policy-based execution guardrails, and audit trails t

This project is an LLM API proxy gateway and compatibility layer designed to route, translate, and proxy requests between model clients and various large language model providers. It functions as a multi-provider router that maps model requests to alternative backends based on configurable tiers and capabilities. The gateway acts as a translation layer that converts API request and response formats between different providers, such as OpenAI or Gemini, to ensure compatibility. It includes a tool-use proxy to handle the execution and processing of model tool definitions and function calls, and

OmniRoute is a unified LLM API gateway that connects multiple AI providers to a single endpoint. Its primary purpose is to simplify the integration of various AI models into tools and agents by translating different provider formats into a standardized API. The project distinguishes itself through a multi-strategy request routing system that optimizes for cost, speed, and availability, including automatic model fallbacks and a circuit-breaker resilience model to isolate provider failures. It employs a local-first security posture, using AES-256-GCM encryption to store API keys and conversatio

chatGPTBox is a browser extension that integrates large language model chat interfaces and AI tools directly into the web browsing experience. It functions as an AI productivity toolkit and API client, allowing users to access AI assistants via a floating chat interface without leaving their active webpage. The project distinguishes itself by offering context-aware assistance and website-specific adaptations based on the current URL. It further enhances the browsing experience by displaying AI-generated responses alongside standard search engine results and providing a system to route chat re

Wenda is an LLM orchestration platform and custom workflow engine designed to manage multiple language model backends through a unified interface. It functions as a self-hosted AI gateway that enables the execution of complex task sequences and automated conversation flows. The system utilizes JavaScript plugins to orchestrate workflows and trigger external API calls. It supports retrieval augmented generation by injecting relevant data from vector stores and offline files into prompts to increase response accuracy. The platform is built for private network deployments, featuring multi-user

This project is a terminal-based command line interface client and agent orchestrator for interacting with multiple large language model providers. It functions as an OpenAI API client and a local API gateway that exposes chat completions and embeddings through an HTTP server. The system distinguishes itself by providing a retrieval-augmented generation tool for indexing local files and URLs into a vector database to provide custom document context. It allows for the creation of specialized AI agents that combine custom system prompts with tool calling and external function execution. The to

CoAI is an enterprise-grade, self-hostable AI gateway platform that unifies access to over 200 AI models from more than 35 providers through a single OpenAI-compatible API endpoint. It functions as a multi-tenant gateway, routing requests across providers with load balancing, automatic failover, and priority-based routing, while exposing standard OpenAI API endpoints for chat, image generation, model listing, and billing to enable seamless integration with existing tools and clients. The platform distinguishes itself through a comprehensive set of operational capabilities built around the gat

This project is a self-hosted AI frontend and web-based chat interface designed to interact with large language model APIs. It functions as an API-based chat client and dashboard that enables users to send prompts and receive responses from generative AI models. The application serves as a self-hosted AI gateway, providing API key proxying to connect official model keys to a web interface. It includes security and traffic controls, such as interface access restrictions via a shared secret key and request volume limiting to prevent service abuse. The system covers conversation data management

Helicone is an AI gateway and observability platform designed to intercept, manage, and monitor interactions with large language models. By acting as a reverse-proxy, it provides a centralized layer for routing requests across multiple AI providers, allowing developers to maintain consistent application logic while gaining deep visibility into model performance, usage, and costs. The platform distinguishes itself through a robust suite of traffic management and prompt engineering tools. It enables policy-driven control, including automatic failover between providers, rate limiting, and edge-b

OpenSquilla is an LLM agent orchestration framework designed to coordinate multi-step AI workflows and tool execution using directed acyclic graphs. It functions as a centralized system for managing specialized skill packages and executing complex reasoning sequences. The project distinguishes itself through a routing gateway that directs tasks to different AI providers based on complexity, cost, and performance. It utilizes a multi-tier AI memory system that organizes working, episodic, and semantic knowledge using local embeddings and SQLite, alongside a secure execution sandbox that isolat

AIClient-2-API is an AI gateway and proxy server that translates diverse large language model interfaces into a single standardized API format. It functions as an OpenAI API compatible proxy and multi-provider orchestrator, allowing a single client to interact with multiple different model backends through a unified interface. The project distinguishes itself by acting as a load balancer that distributes requests across multiple provider accounts using health checks and polling to bypass quota limits. It includes a TLS fingerprint emulator to simulate browser characteristics and prevent API a

gstack is an AI agent framework and development workflow system designed to automate the software development lifecycle. It coordinates specialized AI personas to manage tasks across product design, engineering management, and quality assurance, transforming product intent into technical specifications and final releases. The project is distinguished by its deep integration of headless browser automation and semantic code memory. It utilizes a persistent Chromium daemon for web scraping and visual auditing, and implements a searchable knowledge base that logs architectural decisions and repos

This project is a framework for integrating Large Language Models into the Feishu messaging platform to create automated assistants. It functions as a self-hosted AI assistant and a chatbot gateway that routes messages between chat platforms and remote AI cloud providers. The system features a multi-channel messaging bridge and provider-agnostic model routing, allowing for orchestration between different AI models with automatic failover management. It includes a browser automation agent capable of programmatically controlling web browsers and capturing page snapshots to extend the assistant'

FreeAskInternet is a self-hosted AI search aggregator and answer generation platform. It uses a language model to synthesize results from multiple web search engines into a single, comprehensive response, integrating with SearXNG to gather raw web data. The system is designed for local deployment through Docker containerization, allowing the search aggregator and user interface to run in isolated environments. It supports local language model integration and provides a provider-agnostic interface to switch between different local or remote model backends. The platform handles search and synt

53AIHub is a centralized orchestration platform for deploying and managing AI agents and prompts across multiple large language model providers. It functions as a multi-model AI gateway and an operation portal for AI services, providing a unified interface to coordinate agents and prompts from various external platforms. The project distinguishes itself as a white-label AI portal designed for self-hosted infrastructure, allowing for full control over operational data on private servers or containers. It includes a comprehensive AI SaaS administration layer with a multi-tenant subscription eng

OptiLLM is an inference proxy and gateway router that directs prompts to specific language models based on cost, performance, and provider health. It functions as a middleware layer designed to optimize requests through intelligent routing, load balancing, and context management. The project provides specialized capabilities for data protection by anonymizing personally identifiable information before requests reach a model. It also acts as a reasoning orchestrator and tool integration layer, using inference-time loops and self-reflection to improve accuracy while connecting models to externa

This project is a web-based user interface for interacting with large language models via API keys. It functions as an OpenAI API client and a general LLM web chat interface, allowing users to send prompts and receive responses through a private web portal. The application features a security layer with password-based access control to restrict public usage. It supports custom request routing and proxy configurations to bypass network restrictions, and it is available as a progressive web app for native-like installation on mobile devices. The interface includes rich text rendering for Markd

openai-go is an LLM SDK for Go and a client for interacting with OpenAI services. It provides type-safe bindings to generate text, images, and audio via REST endpoints, enabling the integration of large language models and AI assistant orchestration into Go applications. The library serves as an agent orchestration tool for managing stateful conversation threads and autonomous agents with integrated tool calling and file search. It also functions as an asynchronous batch processing client for monitoring large-scale request groups and fine-tuning jobs, alongside a management SDK for controllin

The Gemini Cookbook is a comprehensive collection of implementation patterns, code samples, and development guides designed for building applications with Google Gemini models. It serves as a central resource for developers to integrate multimodal generative artificial intelligence into their software, providing the necessary frameworks to manage model interactions, stateful workflows, and structured data extraction. The repository distinguishes itself by offering specialized toolkits for autonomous agent orchestration, enabling the construction of agents that can execute code, browse the web

Valuecell is an artificial intelligence financial trading platform and market analysis engine. It functions as a multi-exchange trading bot and financial data orchestrator, designed to analyze market data and execute automated trades across global financial exchanges. The system utilizes a modular agent plugin framework that allows for the integration of third-party tools and agents through a shared community registry. It incorporates a retrieval-augmented generation approach to analyze fundamental financial documents and historical patterns, grounding AI responses in factual data. The platf