megaease/easegress
Easegress
Easegress este un API gateway cloud-native, un ingress controller pentru Kubernetes și un control plane pentru service mesh. Acesta servește drept punct central de intrare pentru gestionarea traficului de rețea, oferind un control plane dedicat și un sidecar data plane pentru a gestiona ciclul de viață și interceptarea cererilor între serviciile distribuite.
Proiectul funcționează ca un gateway pentru modele AI, care face proxy pentru cererile către furnizorii de modele de limbaj mari (LLM) și traduce formatele cererilor pentru compatibilitate. Este un proxy extensibil care permite gestionarea personalizată a cererilor și răspunsurilor printr-un pipeline de filtre implementat via WebAssembly.
Sistemul acoperă capabilități extinse de gestionare a traficului, inclusiv rutare multi-protocol pentru HTTP, MQTT și WebSockets, precum și load balancing și service discovery. Implementează protecții de stabilitate precum circuit breakers și rate limits, și suportă strategii de deployment precum canary și blue-green releases.
Observabilitatea este integrată prin OpenTelemetry pentru trasarea distribuită a cererilor și monitorizarea performanței traficului. Securitatea este gestionată prin validarea token-urilor și semnăturilor, precum și prin gestionarea certificatelor SSL/TLS.
Features
- Ingress Controllers - Serves as a Kubernetes ingress controller to manage external access and route traffic into the cluster.
- Centralized API Gateways - Provides a centralized entry point for routing incoming network requests to various backend microservices.
- AI Gateways - Provides a unified interface for routing requests to multiple AI model providers while maintaining format compatibility.
- Control and Data Plane Separation - Separates network configuration and management in the control plane from the packet forwarding in the data plane.
- Ingress Gateways - Implements specialized ingress gateways for managing external entry points into Kubernetes clusters.
- Proxy Filters - Supports custom request and response handling through a filter pipeline implemented via WebAssembly code.
- Service Mesh Control Planes - Implements a centralized management system for configuring and orchestrating service-to-service network policies.
- Service Meshes - Provides an infrastructure layer to manage service-to-service communication, observability, and security.
- Dynamic Service Discovery - Maps logical service names to physical network addresses in real-time to enable dynamic microservices communication.
- Model Request Proxies - Acts as a gateway that intercepts and routes API requests to various large language model providers.
- System Stability Protections - Prevents cascading failures by implementing rate limiting, circuit breakers, and execution timeouts.
- Content-Aware Routing Rules - Implements routing rules that inspect request headers, paths, and IP addresses to direct traffic.
- Request Token Validators - Validates tokens and digital signatures on every request to enforce access control and security permissions.
- API Access Security - Secures API access through token validation, digital signatures, and stability mechanisms like rate limiting.
- Multi-Protocol Proxies - Functions as a network intermediary supporting multiple protocols including HTTP, MQTT, and WebSockets.
- Request Processing Filters - Executes custom request and response processing logic using portable WebAssembly binary modules.
- Deployment Strategies - Supports various deployment patterns including blue-green and canary releases to manage application rollout.
- Canary Deployment Controllers - Implements controllers to manage incremental traffic shifts for safe canary deployments of API updates.
- Traffic Load Balancers - Distributes network traffic across multiple service instances using round-robin and sticky session policies.
- Multi-Protocol Traffic Orchestration - Routes and manages traffic across multiple protocols including HTTP, MQTT, and WebSockets.
- Zero-Downtime Deployments - Ensures continuous service availability during updates through health-check-gated traffic switching.
- Zero-Downtime Upgrades - Updates service binaries and configurations in place to maintain active network connections without downtime.
- API Orchestration - Provides capabilities to aggregate and manage concurrent requests across multiple external service APIs into single responses.
- Cloud Network Orchestration - Directs network data flow within cloud environments to ensure efficient connectivity between distributed components.
- Circuit Breakers - Prevents cascading failures by automatically stopping traffic to unhealthy backend services.
- Traffic Pipeline Filters - Implements WebAssembly-based custom filters within the traffic pipeline for request transformation and routing.
- SSL/TLS Certificate Management - Manages the lifecycle and deployment of SSL/TLS certificates to secure network traffic.
- Dynamic Service Discovery - Dynamically locates and tracks available backend service instances using external service registries.
- Configuration Hot-Reloading - Refreshes routing rules and system settings in place without requiring a full process restart.
- Distributed Tracing - Generates vendor-neutral distributed traces using unique identifiers to analyze request execution flow across services.
- Request Traffic Monitors - Tracks request volume, processing duration, and error rates to monitor the health of backend servers.
- OpenTelemetry - Integrates with OpenTelemetry to export trace spans to OTLP-compatible backends for distributed tracing.
- OpenTelemetry SDKs - Integrates OpenTelemetry SDKs to generate and export vendor-neutral observability data and distributed traces.
- Infrastructură și containere - A cloud-native traffic orchestration and management system.
- API Gateways - Cloud-native traffic orchestration and gateway system.
- API Gateways and Proxies - Traffic orchestration system for cloud-native architectures.
