Awesome GitHub RepositoriesAPI Gateways

This project is a self-hosted large language model chat interface and AI model aggregator. It provides a unified web environment for interacting with multiple AI providers and local models, acting as a provider-agnostic API gateway to standardize requests across different endpoints. The platform functions as an agentic AI framework and generative UI workspace, enabling the construction of specialized assistants with custom instructions and subagents. It features a sandboxed code interpreter for secure execution of multiple programming languages and a generative UI system that renders interact

This project is an AI-focused API gateway and proxy system designed to intercept, standardize, and route requests across heterogeneous language model providers. It functions as a middleware layer that normalizes incoming traffic and manages authentication, ensuring consistent integration across diverse service interfaces. The system features a programmable routing engine that executes user-defined scripts to evaluate request content in real-time. This allows for dynamic traffic management, where requests are inspected, transformed, and redirected to specific model endpoints based on custom lo

Medusa is a headless commerce engine designed as a modular, API-first platform for building custom digital storefronts and business applications. Its architecture is built on a decoupled system where core business logic is encapsulated into independent, swappable modules that communicate through defined interfaces, allowing developers to incrementally adopt or replace components to fit specific operational needs. The platform distinguishes itself through a highly extensible design that supports complex commerce requirements, including multi-vendor marketplace operations, B2B purchasing workfl

Agent-Reach is an AI agent web gateway and search tool that provides language models with the ability to search and read content from the open web, social media, and community forums without using official APIs. It functions as a routing layer that connects large language models to various internet backends while managing content parsing and connection health. The system enables API-free information retrieval by using open-source backends to extract text and metadata from platforms such as Twitter, Reddit, and YouTube. It converts unstructured website content, RSS feeds, and video transcripts

This project is a self-hosted dashboard portal designed to centralize access to internal applications and infrastructure services. It functions as a configuration-driven platform that automatically discovers and organizes services from container runtimes and cluster management systems, presenting them within a unified, customizable web interface. The system distinguishes itself through a declarative widget framework that allows users to construct dashboard components by mapping raw API responses to visual elements. It includes a secure internal proxy layer that handles authentication, header

Budibase is a low-code application platform and enterprise internal tool builder used to create custom business applications for organizational processes and reporting. It functions as a self-hosted backend as a service, providing the infrastructure to manage database integrations and expose public data interfaces for external application access. The platform includes an AI agent orchestrator for deploying autonomous agents that interact with business data and execute operational tasks. It differentiates itself through self-hosted infrastructure management, allowing the system to run on priva

Zheng is a Spring Boot microservices framework and enterprise J2EE development platform. It functions as a distributed service gateway and identity provider, providing a foundation for building complex business applications and microservices infrastructure. The project includes a comprehensive enterprise content management system and an OAuth2 identity provider for managing single sign-on and third-party social login integrations. It also features a MyBatis ORM code generator that automatically creates database models and boilerplate functions from existing tables. The platform covers a broa

cc-connect is an AI agent messaging bridge and session manager that connects local AI coding agents to third-party messaging platforms. It acts as a multimodal AI chat relay and a OneBot protocol gateway, allowing users to control local AI agents remotely via a variety of chat interfaces. The project distinguishes itself by providing a remote AI agent controller that enables the management of agents through slash commands and a web management dashboard. It supports multi-tenant project orchestration and session-based context isolation, ensuring that independent conversation threads are mainta

mi-gpt is a voice assistant bridge and agent orchestrator that connects smart speakers to large language models. It functions as an integration layer that routes audio requests from hardware speakers to AI providers and converts generated text back into speech via a customizable synthesis system. The project features a retrieval-augmented generation knowledge base that uses embeddings and external documents to provide context-aware responses. It includes a persona definition system for configuring behavioral rules, system prompts, and roleplay characteristics, alongside a plugin architecture

This project is a comprehensive e-commerce platform implementation available as a Spring Boot application, a Spring Cloud microservices architecture, and a version rewritten in the Go programming language. It provides a full-stack retail system featuring a Vue 3 storefront interface and a centralized backend administration portal. The platform is specifically designed to handle high-concurrency flash sales and coupon distribution systems to manage sudden spikes in purchase requests. It supports multiple deployment strategies, ranging from monolithic server-side rendering to a decoupled fronte

This project is a container image registry and server-side storage system designed to house container images, layers, and manifests. It functions as an OCI compliant registry server that adheres to the Open Container Initiative Distribution Specification to store and deliver content over HTTP. The system provides a self-hosted solution for managing private libraries of container images within professional-grade infrastructure. It is designed to enable the development of custom registries by extending a base toolkit with specialized libraries and business logic. The registry covers image dist

Spinnaker is a multi-cloud continuous delivery platform designed to automate software releases and deployment pipelines across various public cloud providers and Kubernetes clusters. It functions as a cloud deployment orchestrator and infrastructure delivery tool, coordinating the promotion of software artifacts through multiple environments using visual workflows and directed acyclic graphs. The platform distinguishes itself with a dedicated canary analysis engine that compares performance metrics between new and stable software versions to automate release decisions. It utilizes cloud-agnos

CoAI is an enterprise-grade, self-hostable AI gateway platform that unifies access to over 200 AI models from more than 35 providers through a single OpenAI-compatible API endpoint. It functions as a multi-tenant gateway, routing requests across providers with load balancing, automatic failover, and priority-based routing, while exposing standard OpenAI API endpoints for chat, image generation, model listing, and billing to enable seamless integration with existing tools and clients. The platform distinguishes itself through a comprehensive set of operational capabilities built around the gat

Shenyu is a microservices API gateway designed to route external traffic to backend services using dynamic rules and protocol conversion. It functions as a central entry point that manages traffic flow through a combination of an API traffic governor, a distributed configuration manager, and a security layer for protecting endpoints. The project features a dynamic plugin architecture that allows for the injection of custom request processing logic without restarting the server. It utilizes a distributed coordination service to synchronize routing and policy updates across a gateway cluster in

Higress 是一个 AI 原生和云原生的 API 网关，用于路由、保护和优化客户端与大语言模型服务之间的流量。它作为微服务的集中入口点，同时充当 Kubernetes Ingress 控制器和 AI 网关编排器。 该项目通过使用统一协议管理跨多个 AI 提供商的流量而脱颖而出，结合了令牌感知速率限制和响应缓存以优化模型推理。它协调 AI 模型与外部工具之间的通信以提供实时上下文和数据，同时还为 AI 代理托管服务器端点。 广泛的功能包括通过 Web 应用防火墙（WAF）实施 API 安全、自动 TLS 证书管理和动态服务发现。该网关通过沙箱化的 WebAssembly 插件支持自定义请求处理，允许通过热重载进行流量转换。 该系统实现了标准化的 Ingress API，以低资源开销管理容器化集群内的网络路由。

Llama-stack 是一个标准化的编排栈和生成式 AI API 网关。它提供了一个统一的通信层和一致的接口，用于部署、管理和与各种大语言模型提供商及部署进行交互。 该系统充当代理（agent）框架，管理工具执行和版本化的技能包，以自动化复杂任务。它包括一个批处理系统，用于通过离线处理处理大量异步请求，以及一个用于存储和搜索文档以实现检索增强生成（RAG）的向量数据库接口。 该栈涵盖了高级功能，包括 AI 代理编排、模型部署以及模型 API 的标准化，从而允许在不重写应用程序代码的情况下切换提供商。

BentoML is a machine learning model serving framework and GPU-accelerated inference server designed to package, deploy, and scale AI models as production-ready REST APIs. It functions as an AI model lifecycle manager and an inference graph orchestrator, enabling the chaining of multiple models and custom logic into complex pipelines for advanced task sequences. The framework distinguishes itself through a dynamic batching engine that optimizes GPU throughput and an artifact-based packaging system that bundles model weights and dependencies into immutable archives for consistent deployment. It

BAML is a prompt engineering framework and LLM client generator that defines AI prompts as type-safe functions. It serves as a structured data extraction tool and workflow orchestrator, transforming unstructured model responses into strongly typed objects using a custom schema language and alignment algorithms. The project distinguishes itself by using a compiler to generate language-specific boilerplate code for API communication and output parsing. It features a dedicated environment for designing complex prompt templates with conditional logic and reusable snippets, and employs genetic alg

SpringCloud-Learning is an educational project that demonstrates how to build microservices using Spring Cloud, covering the core patterns of service discovery, centralized configuration management, and API gateway routing. The project provides hands-on examples for registering and discovering microservice instances with Nacos, Eureka, or Consul, and for routing external API requests through Spring Cloud Gateway with support for filters and load balancing. The tutorials explore service resilience through circuit breakers and rate limiting with Sentinel and Hystrix, including custom fallback l

Aidea 是一个跨平台 AI 客户端和自托管基础设施项目。它由一个 Flutter 应用和一个容器化后端系统组成，旨在提供一个统一的界面，用于与大语言模型和 AI 图像生成服务进行交互。 该项目作为一个自托管 AI 网关运行，允许用户在自己的硬件上管理和部署语言和图像模型的私有实例。这种架构允许通过标准化的 API 网关将不同的数据查询路由到多个 AI 提供商，同时保持对数据存储和服务器配置的控制。 该系统涵盖对话工作流、文本到图像扩散和异步流处理。它利用单一代码库在移动、桌面和 Web 环境中渲染一致的用户界面，并由后端基于容器的服务编排提供支持。