4 Repos
Runtime transformation of SQL statements to facilitate sharding and routing logic.
Distinct from SQL Statement Parsing: Distinct from general parsing; specifically transforms queries to handle sharding keys and routing.
Explore 4 awesome GitHub repositories matching data & databases · Query Rewriting. Refine with filters or upvote what's useful.
Pinot is a distributed, columnar analytical database designed for high-concurrency, low-latency query processing. It functions as a real-time OLAP datastore, enabling interactive, user-facing analytics by ingesting and querying massive datasets from both streaming and batch sources. The system architecture relies on a centralized controller for cluster coordination and a distributed segment-based storage model to ensure horizontal scalability. The platform distinguishes itself through a hybrid ingestion pipeline that unifies real-time event streams and historical batch data into a single quer
Automatically redirects queries to pre-aggregated materialized views to improve performance without user intervention.
JSqlParser ist eine Java-Bibliothek für SQL-Abfrage-Parsing, die rohe SQL-Strings in eine strukturierte Hierarchie stark typisierter Java-Objekte konvertiert. Sie bietet die Möglichkeit, Datenbankabfragen programmatisch zu analysieren und zu manipulieren, indem sie diese als Baum von Objekten darstellt. Die Bibliothek unterstützt sowohl das Parsen von vorhandenem SQL-Text als auch die programmatische Generierung neuer Anweisungen durch eine Fluent-API. Sie enthält Mechanismen zur Transformation von Abfragebäumen und zur Serialisierung strukturierter Objektmodelle zurück in formatierten SQL-Text. Zusätzliche Funktionen umfassen die Datenbank-Schema-Analyse, wie die Extraktion von Tabellennamen zur Abbildung von Datenabhängigkeiten, sowie die SQL-Syntax-Validierung. Der Parser ist konfigurierbar, um verschiedene Syntax-Dialekte zu handhaben, und enthält eine fehlertolerante Wiederherstellung, um die Verarbeitung von Skripten nach dem Auftreten ungültiger Token fortzusetzen.
Navigates and modifies parsed SQL statement trees to rewrite or optimize queries.
pgdog is a PostgreSQL sharding proxy, distributed SQL router, and connection pooler. It is designed to enable horizontal data distribution by splitting tables and indices across multiple independent servers to scale storage and processing capacity. The project distinguishes itself through online resharding capabilities, using logical replication to move data between shards without application downtime. It supports multiple routing strategies, including hash, list, and range-based query routing, and manages distributed atomic transactions using a two-phase commit process to ensure consistency
Parses and transforms SQL statements at runtime to handle sharding keys and route data to correct servers.
Fast-paginate is a database utility designed to optimize pagination performance in PHP and Laravel applications. It functions as a transparent layer that intercepts standard query builders to replace default pagination logic with more efficient retrieval strategies, specifically targeting large-scale datasets where traditional offset and limit operations can become resource-intensive. The library distinguishes itself by implementing deferred join techniques, which retrieve only primary keys in an initial subquery before fetching full records to minimize data scanning. It further improves resp
Intercepts standard query builders to transparently replace pagination logic while maintaining compatibility with existing method signatures.