pgdogdev/pgdog

Features

• PostgreSQL Pool Managers - Implements a multiplexed connection pooler specifically tailored for the PostgreSQL wire protocol and server behavior.
• Connection Pooling - Implements high-performance connection pooling to manage reusable database connection sets for thousands of clients.
• Horizontal Scaling - Splits tables and indices across multiple independent servers to scale storage and processing capacity.
• PostgreSQL Proxy Servers - Provides a network intermediary that intercepts and multiplexes PostgreSQL traffic to manage connection states and session variables.
• Atomic Schema Mutations - Wraps structural queries in two-phase commit transactions to guarantee schema mutations succeed on all shards or none.
• Automatic Failover Controllers - Implements mechanisms that monitor database health and automatically promote standby nodes to primary roles during failures.
• Logical Topology Mapping - Maps logical database names to physical hosts while assigning primary or replica roles.
• Concurrent Shard Data Export - Streams results from all shards concurrently to output a combined data set for large reads.
• Cross-Shard Result Aggregation - Buffers and orders rows returned from multiple shards in memory to ensure correct output sequence.
• Cross-Shard Data Replication - Maintains identical copies of tables on all shards by broadcasting writes and distributing reads.
• Parallel Query Execution - Runs a single query across multiple shards in parallel and assembles the results into one response.
• Logical Replication Ingestion - Implements online resharding by streaming row changes between shards using logical replication protocols.
• Schema Caches - Caches database schemas in memory to automatically identify sharded tables and accelerate routing decisions.
• Online Sharding Key Updates - Moves a row from one shard to another online by automating the select, insert, and delete process.
• Shard Routing Logic - Directs incoming data to a specific shard based on a sharding key or round-robin distribution.
• Automated Sharded Table Detection - Inspects database schemas to automatically identify sharded tables for routing purposes.
• SQL Query Rewriting - Transforms SQL statements to handle sharding key updates and ensure data is routed to correct shards.
• Distributed Atomic Transactions - Uses prepared transactions to ensure atomic writes across multiple shards for consistency across nodes.
• Schema-Based Sharding - Routes queries to different shards based on the fully qualified schema name of the tables.
• Query Routing - Directs SQL queries to the correct database shard based on sharding keys and server health metrics.
• Read-Write Splitting - Implements routing strategies that separate read and write operations, directing writes to the primary and reads to replicas.
• PostgreSQL Database Sharding - Enables horizontal data distribution by splitting tables and indices across multiple independent PostgreSQL servers.
• Distributed Query Routers - Functions as a routing engine that executes queries across multiple shards and aggregates results into a single response.
• Range-Based Query Routing - Provides a routing strategy that directs queries to shards based on column value ranges.
• Read-Only Transaction Routing - Identifies read-only transactions and routes them to replica databases to reduce primary load.
• Replica Load Balancers - Distributes database transactions across multiple primary and replica hosts using various distribution strategies to balance load.
• Schema Change Broadcasting - Sends structural statements to all shards in parallel to maintain consistent table layouts.
• Schema Synchronizers - Coordinates the reloading of schemas across all proxy nodes to ensure consistent routing after structural changes.
• Shard Schema Synchronization - Replicates table definitions and constraints from source to destination shards to ensure compatibility.
• Sharding Proxies - Distributes data across multiple PostgreSQL shards using hash, list, or range-based routing strategies.
• Cross-Shard Data Aggregation - Calculates summaries across multiple shards by combining partial results from each database.
• Query Rewriting - Parses and transforms SQL statements at runtime to handle sharding keys and route data to correct servers.
• Database High Availability - Automates traffic redirection during primary failover and monitors replica health to ensure continuous database access.
• Connection Multiplexing - Shares a small pool of server connections among thousands of concurrent clients to reduce resource overhead.
• Distributed Transaction Coordinators - Coordinates atomic writes across multiple database shards using a two-phase commit protocol to ensure consistency.
• Two-Phase Commit Protocols - Manages a two-phase commit protocol to ensure atomic writes and schema changes across multiple database shards.
• Distributed Transaction Management - Manages distributed atomic transactions using a two-phase commit process to ensure consistency across multiple shards.
• Hash-Based Data Distribution - Distributes data evenly across shards by calculating a hash of the sharding column.
• Database Resharding - Splits existing databases into more shards without downtime by synchronizing data and schema definitions.
• Node Health Tracking - Monitors the operational status of database hosts in real-time to re-route queries away from failing nodes.
• List-Based Shard Routing - Directs queries to specific shards based on a defined mapping of column values to shard identifiers.
• Cross-Shard Query Broadcasting - Forwards a single request to every available shard to query replicated reference tables.
• Distributed Identifier Generators - Generates monotonically increasing 64-bit integers across multiple shards to serve as unique primary keys.
• Uniqueness Enforcement - Validates that primary keys and unique indexes remain unique across multiple distributed shards.
• Execution Plan Analysis - Retrieves and analyzes execution plans for slow queries to assist in performance tuning.
• Database Query Mirroring - Duplicates live queries from a source database to a target database for performance testing or synchronization.
• Multi-Row Insert Distribution - Detects sharding keys in multi-row inserts and rewrites them to ensure each row reaches the correct shard.
• Resharding Identity Validation - Validates table identity modes to ensure updates are correctly applied during online resharding.
• Shard Hint Extraction - Extracts sharding hints from query text or protocol parameters to direct requests to the correct shard.
• Connection Pinning - Directs all statements within a single transaction to one connection to prevent fragmentation.
• Automatic Primary Key Injection - Populates missing primary keys during inserts using a generated unique identifier to maintain integrity.
• Schema Caching - Stores database table structures in memory to automatically identify sharded tables and accelerate routing.
• Parallelized Ingestion - Parses data streams and distributes rows to multiple shards in parallel to accelerate bulk loading.
• Advisory Locking Mechanisms - Ties server connections to specific clients to ensure database advisory locks are maintained during connection reuse.
• Tenant Request Routing - Directs requests to specific databases based on a tenant identifier using mapping logic.
• PostgreSQL Load Balancers - Manages traffic by separating read and write operations and routing queries between primary and replica nodes.
• Statement Synchronization - Caches and synchronizes prepared statements across pooled connections to maintain session compatibility.
• Replication Lag Monitors - Monitors replication delay between primary and replica nodes to enable safe traffic failover.
• Lag-Based Replica Exclusion - Removes replica databases from the load balancer when they exceed defined replication lag thresholds.
• Query Annotators - Appends routing metadata to query outputs to explain how data was distributed across shards.
• Consistency-Based Routing - Routes manually started transactions to the primary database to ensure read-after-write consistency.
• Read Load Balancers - Distributes read traffic evenly across all shards for tables with identical replicated data.
• Parallel Data Migration - Distributes table copy loads across multiple read replicas in parallel to reduce resharding time.
• Shard-Aware Sequence Generators - Configures table columns to use a shard-aware sequence by replacing default values with a generator function.
• Sharded Bulk Loading - Moves large volumes of data across multiple shards using the standard copy protocol.
• Cross-Shard Query Restriction - Blocks queries that attempt to access data across multiple shards to ensure performance and stability.
• Reference Table Replication - Stores copies of reference tables on every shard to enable high-performance local joins.
• Multi-Tuple Insert Splitting - Decomposes insert statements containing multiple tuples and routes each tuple to its corresponding shard.
• Real-Time Runtime Updates - Supports reloading system settings without restarting the process to ensure zero-downtime configuration updates.
• Fleet Coordination - Coordinates a fleet of proxy instances and deployments from a centralized interface.
• Session State Management - Tracks client-specific parameters and updates server settings to prevent session state leakage between pooled connections.
• Network Connection Preservation - Maintains client connections during database incidents to prevent the need for application-side pool recreation.
• Automatic Traffic Switching - Automatically redirects application queries from source to destination clusters during online resharding processes.
• Connection Authentication Mechanisms - Verifies client identities using standard authentication mechanisms to secure access to the proxy.
• Application Data Isolation - Isolates tenant data using either physical database separation or virtual schema-based boundaries.
• Connection Mapping - Tracks client state and transaction boundaries to ensure consistent connection mapping across shards.
• Session Parameter Persistence - Allocates dedicated server connections per client to maintain session-level variables and notifications.
• User-Based Access Restrictions - Validates user access via password-based credentials or cloud-native identity services.
• Control Planes - Links the system to a central management server to coordinate global state and configuration across distributed nodes.
• Routing Extensions - Provides a plugin architecture for extending SQL routing logic via shared libraries.
• Runtime Capability Extensions - Integrates external libraries at runtime to add new functional capabilities without recompiling the binary.
• Plugin-Based Architectures - Implements an architecture that extends core proxy functionality by loading external shared libraries at runtime.
• Migration Progress Monitors - Provides real-time status of table copies and replication lag to determine synchronization for cutover.
• Database Query Monitors - Tracks database queries in real-time to identify and diagnose performance bottlenecks.
• Upstream Health Monitoring - Performs periodic health checks on backend database servers and removes unhealthy nodes from the rotation.
• Database Connectivity Drivers - Maintains compatibility with standard language-specific database drivers for seamless application integration.
• Database Systems - PostgreSQL proxy for connection pooling and sharding.
• Databases & Data - Proxy for PostgreSQL connection pooling and load balancing.

Star-Verlauf