11 repository-uri
Tools for refining database operations to maximize execution speed.
Distinct from SQL Query Execution: Distinct from SQL Query Execution: focuses on performance tuning and resource efficiency rather than just running queries.
Explore 11 awesome GitHub repositories matching data & databases · Query Optimizers. Refine with filters or upvote what's useful.
Apache Flink is a distributed processing engine designed for both high-throughput, low-latency data streams and finite batch workloads. It functions as a stateful stream processor and a SQL stream processing engine, providing a unified runtime to execute relational queries and event-based transformations. The system is distinguished by its ability to manage persistent operator state to ensure exactly-once processing guarantees and consistency during failures. It features specialized capabilities for complex event processing to detect temporal patterns and handles out-of-order events using eve
Parses SQL and applies optimization rules to generate efficient execution code for faster data retrieval.
This project provides a framework for managing multi-agent systems, designed to automate complex software development, infrastructure, and business workflows. It functions as a multi-agent workflow orchestrator that routes tasks to domain-specific workers while maintaining state persistence and infrastructure automation. By leveraging large language models, the system decomposes high-level objectives into actionable plans, ensuring that complex operations are executed with consistency and reliability. The framework distinguishes itself through its hierarchical agent registry and policy-driven
Refines database operations to maximize execution speed and resource efficiency.
TimescaleDB is an open-source PostgreSQL extension that adds native time-series capabilities to the database. At its core, it transforms standard PostgreSQL tables into hypertables—automatically partitioned by time intervals—so data is stored in fixed-size chunks without manual sharding. The extension includes a library of over 200 built-in SQL functions purpose-built for time-series workloads, such as time bucketing, gap filling, percentile estimation, and time-weighted averages. What distinguishes TimescaleDB from generic PostgreSQL is its set of integrated time-series features that work th
Eliminates irrelevant storage chunks and columnar batches through partition pruning, metadata, indexes, and vectorized parallel processing.
This project is a library of source code implementations designed to solve algorithmic challenges and mathematical problems. It serves as a collection of solved LeetCode problems, providing a reference for data structure usage and efficient logic. The repository is a polyglot code collection, implementing the same algorithmic logic across various programming environments, including general-purpose languages, SQL for database queries, and Bash for shell scripting. The content covers a broad range of computational tasks, including data querying, text processing, and the implementation of compl
Implements refined database scripts to retrieve and manipulate data efficiently.
sqlglot is a SQL parser and transpiler that represents queries as abstract syntax trees to enable structural analysis, modification, and semantic transformation. It functions as a dialect translator and query optimizer, converting SQL code between different database engines and simplifying syntax trees through rule-based normalization. The project provides a framework for defining custom SQL dialects by overriding tokenizers, parsers, and generators. It includes a lineage analyzer to track data flow from source tables through complex queries to identify the origin of specific columns. Additi
Provides automated query optimization by rewriting boolean logic and normalizing predicates to improve execution speed.
PgHero is a performance dashboard and diagnostic tool for PostgreSQL. It provides a web interface for monitoring database metrics, analyzing query performance, and managing active connections across multiple database instances. The project distinguishes itself by recording query and storage statistics over time, enabling historical trend analysis through a time-range slider. It also identifies missing indexes by analyzing query patterns and integrates with cloud provider APIs to retrieve system-level hardware statistics such as CPU and IOPS. The tool's broader capabilities cover process admi
Analyzes query patterns and identifies missing indexes to reduce response times and improve database speed.
This project is a comprehensive educational resource and curriculum focused on site reliability engineering, distributed systems, and infrastructure operations. It provides technical guides, a systems engineering course, and instructional manuals designed to teach the principles of managing large-scale computing environments. The curriculum covers high-level architectural design for scalability and resilience, including fault-tolerant infrastructure, high-availability patterns, and microservices decomposition. It emphasizes the practical application of site reliability engineering through the
Teaches the use of B+ tree structures to create indexes that speed up data retrieval.
Pinot is a distributed, columnar analytical database designed for high-concurrency, low-latency query processing. It functions as a real-time OLAP datastore, enabling interactive, user-facing analytics by ingesting and querying massive datasets from both streaming and batch sources. The system architecture relies on a centralized controller for cluster coordination and a distributed segment-based storage model to ensure horizontal scalability. The platform distinguishes itself through a hybrid ingestion pipeline that unifies real-time event streams and historical batch data into a single quer
Provides segment-level pruning to skip irrelevant data during query execution, significantly improving performance.
SQLAdvisor este un instrument de optimizare a performanței bazelor de date și de recomandare a indexurilor, conceput pentru a reduce latența interogărilor. Funcționează ca un optimizator de interogări care analizează tiparele de execuție SQL pentru a identifica indexurile lipsă și pentru a oferi sfaturi acționabile de optimizare a performanței. Sistemul se concentrează pe gestionarea automatizată a indexurilor și pe optimizarea interogărilor de bază de date. Identifică cauzele principale ale răspunsurilor lente ale bazei de date și recomandă cele mai eficiente indexuri pentru a îmbunătăți viteza de regăsire a datelor. Capabilitățile sale includ analiza arborilor de parsare SQL și a tiparelor de join, utilizând selecții bazate pe modele de cost și euristici pentru a prioritiza indexurile. Instrumentul integrează optimizarea conștientă de schemă pentru a evita recomandările redundante de indexuri, reducând în același timp costurile de scanare.
Evaluates database query patterns to provide actionable indexing and performance optimization advice.
KnowledgeGraphCourse este o colecție structurată de materiale academice de nivel absolvent, note de curs și un curriculum cuprinzător axat pe teoria și aplicarea grafurilor de cunoștințe. Acesta servește ca o resursă educațională bazată pe markdown care oferă module de curs navigabile și ghiduri de studiu. Materialul acoperă cercetări specializate privind integrarea grafurilor de cunoștințe cu modelele de limbaj mari pentru a reduce halucinațiile. Include ghiduri detaliate despre utilizarea limbajului SPARQL pentru stocarea seturilor de date grafice la scară largă și executarea interogărilor optimizate. Curriculum-ul acoperă o gamă largă de capabilități, inclusiv extracția cunoștințelor, legarea entităților, învățarea reprezentărilor și integrarea semantică a datelor. Acesta abordează în continuare modelarea cunoștințelor, raționamentul și fuziunea surselor de date eterogene.
Teaches strategies for executing optimized SPARQL queries over large-scale graph datasets.
Fast-paginate is a database utility designed to optimize pagination performance in PHP and Laravel applications. It functions as a transparent layer that intercepts standard query builders to replace default pagination logic with more efficient retrieval strategies, specifically targeting large-scale datasets where traditional offset and limit operations can become resource-intensive. The library distinguishes itself by implementing deferred join techniques, which retrieve only primary keys in an initial subquery before fetching full records to minimize data scanning. It further improves resp
Reduces database load by fetching primary keys in subqueries and bypassing expensive count operations during data retrieval.