apache/apisix

Features

• API Gateways - Manages, secures, and observes traffic for microservices, serverless functions, and AI model providers.
• AI Security Gateways - Routes, monitors, and throttles requests to large language models while enforcing token-based usage and security policies.
• AI Token Budget Controllers - Enforces token-based budget caps on AI model requests to prevent excessive spending.
• Ingress Controllers - Routes external requests into Kubernetes clusters using standard ingress resources and custom definitions.
• Model Request Proxies - Routes incoming API requests to various language model and embedding providers by transforming configurations into provider-specific formats.
• Dynamic Service Proxies - Functions as a programmable proxy that applies policies and routes traffic without requiring service restarts.
• Kubernetes Traffic Controllers - Translates standard ingress resources and custom definitions into live traffic routing rules for containerized environments.
• AI Model Load Balancers - Distributes requests across multiple AI model providers using latency and cost-aware load balancing.
• Lua-Based Plugin Architectures - Executes modular logic within the request lifecycle by embedding a high-performance scripting engine directly into the proxy process.
• AI Observability Tracing - Correlates individual model calls and tool invocations into logs to provide visibility into AI agent reasoning chains.
• Prompt Augmenters - Retrieves relevant information from external data sources and injects it into prompts to improve generated output accuracy.
• Usage Metering & Quotas - Enforces API usage quotas per consumer to ensure subscription compliance and prevent service abuse.
• Distributed Key-Value Stores - Propagates routing rules and policy updates to all gateway nodes in real time using a shared distributed key-value store.
• Response Caching - Stores and serves results for repeated or similar prompts to reduce latency and minimize operational costs.
• Traffic Control - Manages traffic flow and service stability through request rate control and circuit breaking logic.
• Dynamic Configuration Engines - Updates routing rules, certificates, and plugin behaviors in real-time without requiring service restarts.
• SSL Termination Proxies - Terminates encrypted SSL/TLS connections at the gateway to offload cryptographic processing from backend services.
• Traffic Load Balancers - Distributes traffic across backend service instances by continuously monitoring health status and applying weighted routing algorithms.
• Distributed State Management - Synchronizes configuration and rate-limiting state across multiple nodes to ensure consistent traffic control.
• Service Traffic Routing - Routes traffic dynamically to upstream services based on request headers or cookies to support canary releases.
• Circuit Breakers - Implements circuit breaking to stop traffic to unhealthy services and prevent cascading failures.
• Traffic Proxying - Terminates gRPC connections to apply security, rate limiting, and observability policies while preserving streaming semantics.
• Authentication Enforcement Policies - Applies security, authentication, and rate-limiting logic at the gateway layer to decouple cross-cutting concerns from backend services.
• Content Moderation - Inspects prompts and responses for policy violations or malicious injection attempts to ensure consistent security enforcement.
• API Request Authentication - Verifies consumer identity using keys or tokens to link incoming traffic to specific billing accounts and usage records.
• Mutual TLS Authentication - Enforces mutual TLS authentication for incoming client connections to ensure secure, identity-verified communication.
• Multi-Protocol Proxy Managers - Provides centralized management for diverse proxy standards and protocols to bridge incompatible service architectures.
• Monitoring and Observability - Collects and exports metrics, logs, and distributed tracing data to monitor backend service performance.
• AI Service Integrations - Proxies requests to language model providers while adding features like token-based rate limiting, prompt decoration, and content moderation.
• Service Mesh And Gateways - Offers a dynamic, high-performance API gateway.
• API Development - Cloud-native gateway for managing and securing API traffic.
• API Gateways - High-performance gateway with real-time traffic management.
• API Response Caching - Stores backend responses at the gateway layer to serve repeat requests faster and reduce upstream processing load.
• API Traffic Management - Splits traffic between different service versions to enable canary deployments and controlled rollouts.
• Automated Service Reliability - Automates service health monitoring and recovery by retrying requests or switching to backup providers upon failure.
• Distributed - Maintains consistent rate limiting across multiple gateway nodes by synchronizing request counts via external storage.
• Service Discovery - Detects available service endpoints and their health status from external registries to ensure traffic is routed to functional instances.
• API Gateway Configurations - Provides a unified interface to create, update, and query gateway configurations including routes and services.
• Tracing Context Propagation - Injects standard headers into requests to track their path across services, enabling end-to-end visibility into latency and flows.
• Protocol Bridges - Proxies and transcodes traffic between diverse communication standards to enable connectivity across heterogeneous architectures.
• Event-Driven Loops - Handles incoming traffic through a non-blocking event loop that enables high-concurrency proxying and low-latency request transformation.
• Access Control and Authorization - Issues and verifies access tokens using standard grant types to ensure secure resource access for authorized clients.
• OIDC Authentication Plugins - Validates incoming requests against external identity providers and manages session state to control access to protected upstream resources.
• JSON Web Tokens - Verifies the digital signature and claims of self-contained tokens to ensure stateless identity verification for incoming requests.
• Distributed Tracing - Sends request telemetry to compatible collectors to visualize and analyze the lifecycle of requests across microservices.
• Enterprise AI Integration Tools - Connects language models to internal data sources to ground generated responses in specific organizational context.
• Plugin Execution Engines - Executes external logic as sidecar processes to extend gateway functionality beyond built-in features.
• Protocol Gateways - Routes and load balances traffic for specialized communication protocols to ensure reliable connectivity across diverse backend architectures.
• Concurrent Authentication Methods - Applies multiple authentication strategies to a single route to support complex migration paths or diverse client requirements.
• Cross-Origin Resource Sharing Policies - Manages cross-origin requests by defining allowed origins and permissions to control how browsers interact with protected resources.
• Cross-Site Request Forgery Protections - Generates and validates security tokens to protect state-changing API operations from unauthorized cross-site request forgery attacks.
• Mutual TLS Configurations - Configures distinct mutual TLS requirements for individual routes to enable flexible security enforcement across different service endpoints.
• Secret Management Integrations - Integrates with external secret management systems to securely store and retrieve sensitive credentials used by the gateway.
• Plugin Execution Engines - Executes modular logic at specific stages of the request lifecycle to extend gateway functionality.
• Metrics Exporters - Sends request and response performance data to monitoring servers to track latency, request counts, and traffic volume.
• Request Logs - Records detailed usage data such as token counts and response latency into access logs for auditing and performance analysis.
• Request Body Handling - Modifies request headers, bodies, or protocols before they reach the backend and adjusts responses before they are returned to the client.
• Protocol Buffers - Stores and manages binary serialization definitions to facilitate communication and transcoding for high-performance remote procedure call services.
• JSON Message Serializers - Maps RESTful HTTP endpoints and JSON payloads to binary methods and messages to serve existing clients.
• API Billing Services - Facilitates tiered service plans and billing by grouping API users into distinct entities with unique credentials.
• Containerized Deployments - Installs on infrastructure using pre-built container images to simplify setup and ensure compatibility.
• Serverless Function Management - Proxies requests to cloud-native serverless platforms to execute custom logic as dynamic upstream targets.
• Session Token Refreshers - Exchanges expired access tokens for new ones using refresh tokens to maintain continuous client access.
• API Aggregators - Combines responses from multiple backend services into a single unified response to reduce client-side complexity.
• Request Integrity Verification - Compares hash-based message authentication codes between the client and the gateway to ensure data integrity and authenticity.
• Backend-to-Frontend Bridges - Converts browser-based requests into native remote procedure calls to allow frontend applications to communicate directly with backend services.

Star history