Open-source alternatives to Chatgpt Api

Octelium is a zero-trust network access platform and identity-aware proxy designed to secure private HTTP, SSH, and SQL resources. It functions as a secure gateway that validates human and workload identities using OIDC, SAML, and FIDO2 passkeys before granting access to internal applications and SaaS APIs. The system is distinguished by its secretless access broker, which injects credentials—such as API keys, passwords, and AWS Sigv4 signatures—at the gateway level so users can access databases and cloud resources without managing secrets. It further specializes in AI gateway administration,

mcp-use is a development framework designed for building, deploying, and managing servers, clients, and autonomous agents using the Model Context Protocol. It provides a comprehensive toolkit for creating servers that expose custom tools, data resources, and prompts to compatible AI agents. The project distinguishes itself by offering a complete lifecycle for protocol-based applications, including a dedicated hosting platform for production servers and a compliance validator to ensure servers meet marketplace publishing requirements. It also features an observability suite for tracing protoco

PraisonAI is an autonomous AI agent platform that coordinates multiple LLM-powered agents for research, planning, and execution of complex workflows. It functions as a multi-agent orchestration framework, a workflow builder, and a Model Context Protocol server, while also providing retrieval-augmented generation through vector knowledge bases. Agents can interact via CLI, web, or standardized protocols with sandboxed code execution. The platform distinguishes itself with a rich set of agent communication protocols, including A2A, REST, WebSocket, voice and telephony integration, and MCP, allo

mcp-go is a Go implementation of the Model Context Protocol (MCP) providing an SDK and framework for building servers that connect large language model applications to external tools and data sources. It serves as a developer kit for implementing bidirectional communication and structured data exchange between AI clients and servers. The framework enables the creation of executable tools with structured output schemas, reusable prompt templates, and data resource exposure via URI templates. It supports multiple transport layers, including stdio, HTTP, and Server-Sent Events, using a transport

The inspector is a diagnostic and validation tool for the Model Context Protocol. It provides an interactive interface and a transport proxy to discover, inspect, and execute the tools, prompts, and resources provided by an MCP server. The project serves as a debugger and compliance tester to verify that server implementations adhere to the protocol specification and JSON-RPC standards. It allows for real-time monitoring of message exchanges and logs between clients and servers across various transport layers, such as standard input/output and Server-Sent Events. The tool covers a broad rang

This project is a Model Context Protocol server that connects large language models to the Xiaohongshu social media platform. It acts as a connector and API wrapper, enabling language models to programmatically search, read, and publish media and text. The system provides automation for content discovery and publishing, allowing for the creation of image and video posts with associated titles and descriptions. It also facilitates social engagement by managing the posting of comments and tracking engagement metrics for specific entries. The tool covers data retrieval for user profiles, post d

This project is a curated library of community-driven prompt templates and personas designed to improve interactions with large language models. It functions as a prompt engineering guide, providing interactive tutorials and examples to teach advanced design and reasoning techniques. The library can operate as a Model Context Protocol server, providing a standardized interface for AI tools and agents to access prompt data as a service. For organizations, it offers a self-hosted repository option that allows for private deployment on internal infrastructure with custom authentication and data

git-mcp is a Model Context Protocol server that transforms Git repositories and static sites into structured context providers for AI assistants. It functions as a documentation retrieval tool and repository indexer, exposing codebases and project files as standardized tools to reduce hallucinations in large language model responses. The project converts raw repository files, READMEs, and external URLs into formats optimized for token consumption. It enables AI agents to perform query-based code searches and retrieve specific sections of project documentation to maintain up-to-date technical

This project is a Python framework for building autonomous, event-driven agent systems. It provides a unified runtime for orchestrating multi-agent workflows, managing persistent conversation state, and executing code within secure, isolated sandbox environments. The framework is designed to handle complex task delegation, allowing agents to invoke other agents as tools while maintaining context across multi-turn interactions. The framework distinguishes itself through its deep integration with the Model Context Protocol, enabling agents to connect to external data sources and remote services

WeKnora is a multi-tenant retrieval-augmented generation (RAG) knowledge platform and autonomous AI agent framework. It transforms raw documents into queryable knowledge bases and integrates large language models with vector databases to provide grounded AI responses. The system also functions as a Model Context Protocol (MCP) tool server, exposing knowledge search and agentic capabilities to external AI clients. The platform distinguishes itself through an autonomous agent framework that utilizes iterative reasoning, tool calling, and web search to solve multi-step tasks. It implements a sta

Deepagents is an LLM agent orchestration platform and stateful application server designed for deploying and managing AI agents built with computational graphs. It provides a containerized runtime environment that handles agent execution, state persistence, and the versioning of AI assistants. The platform distinguishes itself through deep integration with the Model Context Protocol, allowing agents to function as servers that expose tools and capabilities to external clients. It features a sophisticated observability suite for capturing execution traces, performing LLM-based evaluations agai

Nexent is an enterprise AI control plane and LLM agent orchestration platform. It provides a zero-code environment for designing, deploying, and managing production AI agents through a multi-agent collaboration framework that coordinates specialized autonomous agents using standardized messaging protocols. The platform integrates the Model Context Protocol to connect agents with external tools, plugins, and services via a universal communication interface. It further distinguishes itself with a dedicated RAG knowledge base manager that imports unstructured documents and utilizes hybrid search

Headroom is an AI gateway proxy and token optimizer designed to reduce the cost and latency of large language model interactions. It functions as an intermediary that intercepts traffic between clients and providers to apply context compression, request routing, and format translation. The system differentiates itself through a Model Context Protocol server implementation that delivers compression and retrieval tools to compatible AI hosts. It employs a content-aware compression pipeline and tiered importance scoring to trim redundant data from logs and tool outputs while preserving essential

qmd is a local semantic search engine and RAG knowledge base indexer that functions as a Model Context Protocol server. It converts local documents, markdown files, and codebases into a searchable database to provide retrieval augmented generation capabilities for AI agents. The system exposes its search and retrieval tools via stdio or HTTP. It utilizes local model files for embeddings and reranking, supporting query expansion across multiple languages. The project employs abstract syntax tree based chunking to split source code at function and class boundaries. It implements hybrid vector-

This project is a web-based user interface for interacting with large language models, featuring streaming responses and persistent conversation history. It functions as an orchestration gateway that directs user prompts to specific language models and acts as a Model Context Protocol client to execute external tools and incorporate live data into conversations. The application includes a routing layer that analyzes input signals and tool requirements to dynamically direct messages to the most appropriate specialized model. It also provides customization settings for brand identity, allowing

Higress is an AI-native and cloud-native API gateway that routes, secures, and optimizes traffic between clients and large language model services. It functions as a centralized entry point for microservices, serving as both a Kubernetes ingress controller and an AI gateway orchestrator. The project distinguishes itself by managing traffic across multiple AI providers using a unified protocol, incorporating token-aware rate limiting and response caching to optimize model inference. It coordinates communication between AI models and external tools to provide real-time context and data, while a

Claude Code Templates is a comprehensive framework for orchestrating specialized AI agents and automating development workflows within local environments. It provides a structured system for defining, configuring, and deploying AI personas that handle specific technical tasks, ranging from backend architecture and frontend implementation to security auditing and infrastructure management. The project distinguishes itself through a configuration-driven approach that allows teams to standardize development environments and share reusable agent definitions across projects. It includes a robust C

Nanoclaw is an LLM agent orchestrator and multi-platform chat gateway designed to deploy and manage isolated AI agents. It provides a containerized runtime that executes agents within sandboxed Linux containers, ensuring filesystem and state isolation through dedicated workspaces and host bind-mounts. The project distinguishes itself through a unified routing pipeline that connects agents to diverse messaging platforms, including WhatsApp, Discord, Slack, Telegram, Signal, and iMessage. It integrates the Model Context Protocol to extend agent capabilities via managed external data and functio

Lago is an open-source billing platform designed for managing subscriptions, usage-based metering, and automated invoicing. It functions as a comprehensive system for defining pricing plans, tracking real-time consumption via a metering engine, and controlling feature entitlements based on active customer subscriptions. The platform differentiates itself through a dynamic billing engine that supports hybrid pricing models and a credit-based wallet system for managing prepaid funds. It includes specialized tools for multi-tenant entitlement mapping, allowing operators to tie specific product p

Mods is a terminal-based AI client that sends prompts to large language models and streams responses back to the command line. It functions as a multi-provider AI gateway, routing queries to OpenAI, Cohere, Groq, Gemini, and local endpoints, and includes a conversation history manager that saves, caches, branches, and resumes text-based interactions. The tool also operates as a Model Context Protocol client, connecting to external MCP servers via stdio, SSE, or HTTP to extend model capabilities with specialized tools and data. The project distinguishes itself through a config-driven provider

This project is a secure intermediary proxy gateway for large language model APIs. It functions as a relay service that forwards requests to AI providers while managing service accounts and routing traffic. The service provides a compatibility layer that supports multiple endpoint formats, allowing different third-party AI clients to communicate with a single provider. It distinguishes itself through a service account management system that assigns individual proxy settings to multiple accounts to prevent IP bans and distributes traffic via load balancing to avoid rate limits. The system inc

n8n-skills is a collection of technical guides and architectural frameworks for designing, building, and deploying automation workflows and AI agents within n8n. It provides a structured approach to creating autonomous agents by combining large language model chains with memory systems and custom toolsets. The project focuses on extending AI capabilities through the development of custom tool functions using structured input schemas and the integration of Model Context Protocol servers. It emphasizes the use of specific architectural patterns to manage webhooks, APIs, and binary data handling

This is an open-source framework for building stateful, durable AI agents that run on Cloudflare Workers. It provides a runtime for long-lived agents that maintain a persistent identity, local SQL storage, and real-time connections, utilizing a lifecycle where agents hibernate when idle and wake on demand. The project distinguishes itself through its multi-channel orchestration, allowing a single agent to be deployed across voice, email, and chat interfaces with unified state. It implements the Model Context Protocol for standardized tool and data exchange and includes a dedicated framework f

Prompt Optimizer is a framework designed for the iterative refinement and testing of text-based instructions for large language models. It functions as an automated evaluation pipeline that systematically adjusts prompt structure, constraints, and clarity to improve the accuracy and consistency of model outputs. The system distinguishes itself through a model-agnostic interface that standardizes communication across different artificial intelligence providers. It incorporates a versioned asset management system to track prompt history, enabling developers to maintain consistency and perform r

Kill Bill is a subscription billing platform and usage-based billing engine designed to manage recurring invoicing and automated payment collection. It functions as a multi-tenant billing infrastructure, providing isolated environments for different organizational entities through a dedicated API. The system is distinguished by a plugin-based extension framework that allows for the integration of third-party payment gateways and custom business logic. It includes a payment gateway orchestrator to handle transactions and refunds, as well as a revenue recognition system to allocate contract rev

Pollinations is a generative AI content platform and model gateway that provides a unified multimodal API for producing text, images, audio, and video. It functions as an AI monetization framework, managing user wallets, spending limits, and revenue sharing for applications that integrate generative tasks. The platform includes a specialized web generator that transforms natural language prompts into functional single-page websites. It distinguishes itself by offering a stateless public API that allows for the generation of media and text via HTTP requests without requiring user authenticatio