1 مستودع
Parallel streaming of data from multiple database shards to produce a single combined result set.
Distinct from Data Sharding: Shortlist candidates focus on partitioning strategies or in-memory maps, not the concurrent export of results from multiple shards.
Explore 1 awesome GitHub repository matching data & databases · Concurrent Shard Data Export. Refine with filters or upvote what's useful.
pgdog is a PostgreSQL sharding proxy, distributed SQL router, and connection pooler. It is designed to enable horizontal data distribution by splitting tables and indices across multiple independent servers to scale storage and processing capacity. The project distinguishes itself through online resharding capabilities, using logical replication to move data between shards without application downtime. It supports multiple routing strategies, including hash, list, and range-based query routing, and manages distributed atomic transactions using a two-phase commit process to ensure consistency
Streams results from all shards concurrently to output a combined data set for large reads.