sysown/proxysql
Proxysql
ProxySQL is a database proxy designed to route and balance traffic between applications and MySQL or PostgreSQL servers. It provides database high availability by monitoring backend server health and automatically rerouting traffic to healthy nodes during failover events to prevent downtime.
The system integrates with generative AI models by proxying requests through a protocol handler, creating a bridge that allows large language models to access structured data.
The project includes capabilities for traffic management through automatic failover routing and cluster topology discovery. It optimizes performance using multiplexing-based connection pooling and parsed-query result caching. Observability is provided through real-time query logging, anomaly detection, and a time-series metric subsystem.
Security is managed via transport layer security encryption, IP-based access control, and LDAP authentication. Operational settings are managed through a SQL-based runtime configuration interface and file-based bootstrapping.
Features
- MySQL Proxy Middleware - Provides specialized middleware for proxying and routing traffic to MySQL database clusters.
- Database High Availability - Monitors backend server health and automatically reroutes traffic to healthy nodes during failover events.
- Automatic Failover Controllers - Automatically redirects traffic to healthy nodes during failover events to ensure high availability.
- Connection Pooling - Implements multiplexing-based connection pooling to reuse persistent backend connections across transient client sessions.
- Connection Pooling - Optimizes performance by managing a shared pool of persistent backend connections to be reused across client sessions.
- Traffic Routing - Routes database queries to specific server groups based on replication status and failover rules.
- Real-Time Runtime Updates - Enables real-time updates to operational settings and routing rules without requiring a service restart.
- Cluster State Synchronization - Implements an algorithm to synchronize configuration and routing state across multiple distributed proxy instances.
- Real-time Configuration Updates - Allows operational settings and routing rules to be updated in real-time via an administrative interface.
- SQL-Based Administration - Provides an administrative database interface to update system settings and routing rules using SQL.
- Database Performance Monitoring - Captures real-time query logs and performance metrics to analyze database behavior and identify anomalies.
- Health-Driven Routing - Reroutes traffic automatically based on backend server health, replication lag, and responsiveness.
- Upstream Health Monitoring - Continuously monitors the connectivity, read-only status, and replication lag of backend database servers.
- Node Health Tracking - Uses ping-based monitoring to track node responsiveness and automatically remove unhealthy servers from the pool.
- Query Logging - Captures real-time query events and parameters into buffers or databases for auditing and performance analysis.
- Large Language Model Integration - Provides a bridge for generative AI models to securely access structured data via specialized protocol handlers.
- Cluster Topology Management - Automatically detects and organizes members of cloud-based and replicated database clusters.
- Query Result Caching - Caches the outputs of parsed queries to serve identical future requests without hitting the backend database.
- Time Series Data Storage - Implements a specialized internal subsystem for capturing and analyzing high-frequency time-series performance metrics.
- Connection Limit Managers - Provides a control plane to define backend server lists and manage individual connection limits.
- Query Caching Strategies - Stores the results of frequent database queries to serve repeat requests faster and reduce backend load.
- High Availability Systems - Includes a process monitoring system that automatically restarts the service upon failure to ensure uptime.
- SSL/TLS Connection Security - Secures data transmission between clients and servers using certificate-based TLS encryption.
- Transport Layer Security - Secures data transmission between clients and servers using certificate-based encryption and mutual authentication.
- Plugin Architectures - Provides a modular architecture for injecting custom logic into the proxy via lifecycle hooks.
- Anomaly Detection - Analyzes database traffic patterns to identify and flag irregular behavior and potential issues.
- Query Retries - Implements fault tolerance by redirecting failed requests to alternative backend servers.
- IP Access Restrictions - Provides a firewall whitelist capability to block or allow access based on the originating client IP address.
- Metrics Exporters - Exposes a native monitoring endpoint for global metrics and query statistics for external analysis.
- Network Traffic Analysis - Implements a fast-forward observer to monitor internal data flow and network traffic patterns.
- Time-Series Performance Metrics - Captures and stores high-frequency performance data in a specialized internal format for real-time analysis.
- Query Execution Hooks - Injects custom logic into the query execution flow using pre-execution hooks and a defined sequence of lifecycle events.
- Server and Infrastructure - Acts as a high-performance proxy for database traffic.
