4 repositorios
Runtime transformation of SQL statements to facilitate sharding and routing logic.
Distinct from SQL Statement Parsing: Distinct from general parsing; specifically transforms queries to handle sharding keys and routing.
Explore 4 awesome GitHub repositories matching data & databases · Query Rewriting. Refine with filters or upvote what's useful.
Pinot is a distributed, columnar analytical database designed for high-concurrency, low-latency query processing. It functions as a real-time OLAP datastore, enabling interactive, user-facing analytics by ingesting and querying massive datasets from both streaming and batch sources. The system architecture relies on a centralized controller for cluster coordination and a distributed segment-based storage model to ensure horizontal scalability. The platform distinguishes itself through a hybrid ingestion pipeline that unifies real-time event streams and historical batch data into a single quer
Automatically redirects queries to pre-aggregated materialized views to improve performance without user intervention.
JSqlParser es una biblioteca Java para el análisis de consultas SQL, que convierte cadenas SQL sin procesar en una jerarquía estructurada de objetos Java fuertemente tipados. Proporciona los medios para analizar y manipular programáticamente las consultas de bases de datos representándolas como un árbol de objetos. La biblioteca admite tanto el análisis de texto SQL existente como la generación programática de nuevas sentencias a través de una API fluida. Incluye mecanismos para transformar árboles de consulta y serializar modelos de objetos estructurados de nuevo en texto SQL formateado. Las capacidades adicionales incluyen el análisis de esquemas de bases de datos, como la extracción de nombres de tablas para mapear dependencias de datos, y la validación de sintaxis SQL. El analizador es configurable para manejar diferentes dialectos de sintaxis e incluye recuperación tolerante a errores para continuar procesando scripts después de encontrar tokens no válidos.
Navigates and modifies parsed SQL statement trees to rewrite or optimize queries.
pgdog is a PostgreSQL sharding proxy, distributed SQL router, and connection pooler. It is designed to enable horizontal data distribution by splitting tables and indices across multiple independent servers to scale storage and processing capacity. The project distinguishes itself through online resharding capabilities, using logical replication to move data between shards without application downtime. It supports multiple routing strategies, including hash, list, and range-based query routing, and manages distributed atomic transactions using a two-phase commit process to ensure consistency
Parses and transforms SQL statements at runtime to handle sharding keys and route data to correct servers.
Fast-paginate is a database utility designed to optimize pagination performance in PHP and Laravel applications. It functions as a transparent layer that intercepts standard query builders to replace default pagination logic with more efficient retrieval strategies, specifically targeting large-scale datasets where traditional offset and limit operations can become resource-intensive. The library distinguishes itself by implementing deferred join techniques, which retrieve only primary keys in an initial subquery before fetching full records to minimize data scanning. It further improves resp
Intercepts standard query builders to transparently replace pagination logic while maintaining compatibility with existing method signatures.