20 个仓库
The process of analyzing database execution plans to optimize query performance.
Distinct from Database Query Execution: Focuses on the visualization and analysis of the plan (joins, index usage) rather than the act of executing the query.
Explore 20 awesome GitHub repositories matching data & databases · Execution Plan Analysis. Refine with filters or upvote what's useful.
Nebula is a distributed graph database designed for storing and querying massive volumes of interconnected vertices and edges across a horizontally scalable cluster. It functions as a Kubernetes-native database and a distributed graph analytics engine, utilizing a Raft-based distributed store to ensure strong consistency and high availability. The system features an OpenCypher query engine for performing complex graph traversals and pattern matching. It distinguishes itself with a decoupled compute-storage architecture and a shared-nothing distributed design, allowing query processing and dat
Provides tools to analyze query execution plans and profiling data to identify and resolve performance bottlenecks.
Apache DataFusion is an extensible, columnar SQL query engine that runs embedded within a host application without requiring a separate server process. It processes data in columnar batches using Apache Arrow for memory-efficient analytics, and can scale analytic workloads across multiple nodes for parallel execution. The engine supports both SQL and DataFrame queries through a modular, streaming architecture that allows custom operators, data sources, functions, and optimizer rules. The engine distinguishes itself through its modular extension framework, which enables building custom query e
Displays the physical plan and execution metrics of a query using EXPLAIN and EXPLAIN ANALYZE.
Soar is a suite of specialized tools designed for analyzing MySQL performance, advising on indexing, and optimizing SQL syntax. It functions as a performance analyzer, index advisor, and query optimizer to identify bottlenecks and suggest structural improvements for faster execution. The project distinguishes itself through a system for rewriting SQL statements into optimized equivalent versions using custom heuristic rules and patterns. It also features a dedicated index advisor that evaluates query patterns and database metadata to recommend the creation of new indexes. Its broader capabil
Analyzes database execution plans and explain output to detect inefficient access types and key usage.
This project is a comprehensive educational resource and curriculum focused on site reliability engineering, distributed systems, and infrastructure operations. It provides technical guides, a systems engineering course, and instructional manuals designed to teach the principles of managing large-scale computing environments. The curriculum covers high-level architectural design for scalability and resilience, including fault-tolerant infrastructure, high-availability patterns, and microservices decomposition. It emphasizes the practical application of site reliability engineering through the
Teaches how to generate and visualize execution plans to identify bottlenecks in table joins and index usage.
Azure Data Studio is a cross-platform SQL database management IDE used for writing queries, managing schemas, and administering relational databases. It functions as a comprehensive environment for relational database management, providing a structured interface for executing SQL queries and browsing database objects. The platform is distinguished by its interactive data notebooks, which combine executable code cells, narrative text, and visualizations for data analysis. It also includes specialized tools for database migration, allowing users to assess and transfer schemas and data from on-p
Visualizes estimated and actual execution plans graphically to identify expensive operators and optimize performance.
Pinot is a distributed, columnar analytical database designed for high-concurrency, low-latency query processing. It functions as a real-time OLAP datastore, enabling interactive, user-facing analytics by ingesting and querying massive datasets from both streaming and batch sources. The system architecture relies on a centralized controller for cluster coordination and a distributed segment-based storage model to ensure horizontal scalability. The platform distinguishes itself through a hybrid ingestion pipeline that unifies real-time event streams and historical batch data into a single quer
Generates detailed breakdowns of execution steps to help optimize complex joins and distributed data reshaping.
SparkInternals 是一份技术参考和架构指南,详细介绍了 Apache Spark 分布式计算引擎的内部设计和实现。它作为大数据引擎分析的研究资料,重点关注系统如何管理集群执行以及驱动节点(Driver)、执行器(Executor)和工作节点(Worker)之间的交互。 该项目详细分解了逻辑计划如何转换为物理执行阶段。它专门分析了数据 Shuffle 操作、内存管理以及分布式作业调度协调的机制。 该文档涵盖了广泛的分布式计算功能,包括查询执行规划、数据依赖管理和内存缓存策略。它还研究了任务分配、并行执行以及用于故障恢复和数据持久化的过程。
Analyzes how execution flows are decomposed into jobs and stages to visualize concrete compute operations.
Octosql 是一个联邦 SQL 查询引擎、数据转换器和流式 SQL 处理器。它允许用户跨多个异构数据源(包括不同类型的数据库和文件格式)执行单一 SQL 语句,从而合并并转换结果集。 该系统的独特之处在于将 CSV、JSONLines 和 Parquet 文件视为虚拟表,并利用基于插件的架构扩展对外部存储引擎的连接。它作为无限数据流的流式处理器,使用水印(watermarks)、撤回(retractions)和翻滚窗口(tumbling windows)来维持乱序事件的一致性。此外,它还可用作 SQL 数据生成器,通过表值函数生成合成数据集和记录流。 该引擎具备跨源数据连接和多源分析能力,并通过源端谓词下推(predicate push-down)进行优化,以减少数据传输。它通过包含联合类型的静态类型系统管理复杂数据,并提供查询执行计划可视化功能以增强可观测性。
Generates visual representations of execution plans to verify predicate push-down and optimization logic.
Pigsty 是一个全面的数据库基础设施编排平台,旨在自动化高可用 PostgreSQL 集群的全生命周期。它作为一个基础设施即代码(IaC)框架,通过幂等 Playbook 管理集群协调、节点配置与服务发现。通过集成分布式共识机制,该平台确保了在包括裸机与虚拟化基础设施在内的多样化环境中,自动化故障转移与一致的状态强制执行。 该平台通过一套超越标准数据库管理的强大运营能力脱颖而出。它具备内置的观测流水线,将指标、日志与追踪聚合到集中式仪表盘中,用于实时性能监控与诊断分析。此外,它还提供了一个模拟专有线路协议与 SQL 语法的迁移框架,允许将遗留企业数据库工作负载集成到现代关系型环境中。 该系统涵盖了广泛的功能面,包括带有写时复制(CoW)克隆以实现快速部署的高级存储管理,以及协调关系型引擎与缓存及对象存储服务的多数据库编排。它还整合了安全加固、自动化备份与恢复,以及通过分层代理进行的流量路由,以将客户端连接与底层集群拓扑解耦。 该项目以自包含的包镜像模型分发,能够在安全或离线环境中实现一致的部署与依赖管理。
Displays database execution plans as visual diagrams to help developers identify and resolve performance bottlenecks.
Eko 是一个用于设计和部署智能体工作流的框架,具有 LLM 智能体工作流编排器和浏览器自动化引擎。它提供了一个用于执行系统级操作和管理本地文件的服务端进程管理器,以及一个用于在自动化决策过程中进行人工监督和指导的“人在回路”智能体控制器。 该系统通过基于角色的分区和工作流编排来协调多智能体协作,将复杂任务划分为不同的角色并管理执行交接。它集成了模型上下文协议(Model Context Protocol),以标准化智能体与外部工具或数据源之间的连接。 该平台包括无头浏览器自动化、网页抓取以及使用基于循环的事件监听进行重复任务自动化的功能。它还具有执行计划流功能,可实时可视化智能体的内部规划过程。
Features execution plan streaming to visualize an agent's internal planning process in real-time.
Pigsty is a full-stack orchestration suite for deploying, monitoring, and managing high-availability PostgreSQL clusters and their supporting infrastructure. It functions as a cluster management platform and high-availability suite that automates failover, manages virtual IPs, and ensures data consistency through distributed consensus. The project distinguishes itself by providing a comprehensive database infrastructure-as-code framework and a dedicated observability stack. It incorporates a backup and recovery manager supporting point-in-time recovery via S3-compatible object storage, alongs
Renders PostgreSQL EXPLAIN output into a visual format to identify query performance bottlenecks.
H2 是一个用 Java 编写的 JDBC 兼容关系型数据库管理系统。它作为一个可嵌入的 SQL 数据库,可以直接在应用程序进程内运行以消除网络延迟,或者作为内存数据库用于高性能的易失性存储。它还包含一个基于 Web 的控制台,用于执行 SQL 命令和管理模式。 该系统的特点是其灵活的部署模式,包括用于远程 TCP/IP 访问的独立服务器模式,以及用于同时进行本地和远程连接的混合模式。它具有方言模拟层和兼容模式,允许其模仿其他数据库系统的行为和语法。 该引擎提供了一套广泛的功能,涵盖具有多版本并发控制(MVCC)的 ACID 事务、地理空间和 JSON 数据支持,以及高级分析窗口函数。它包括通过压缩备份、SQL 脚本恢复和堆外内存管理来处理大数据集的数据保护工具。 该数据库使用标准的 Java 数据库连接驱动程序和连接 URL 与应用程序集成。
Inspects internal execution plans and scan counts to optimize index usage and query performance.
TablePro is a cross-platform database management client designed for browsing, querying, and administering both SQL and NoSQL databases. It functions as a unified workspace that integrates a code-centric SQL editor with schema visualization tools, allowing developers to manage complex data models and execute queries across diverse database engines. The application distinguishes itself through an agentic AI integration layer that connects language models directly to database tools, enabling automated query generation, optimization, and error fixing with configurable approval gates. It features
Visualizes database query plans as interactive diagrams or trees to identify performance bottlenecks.
MongoDB Python Driver 是一个客户端库和 NoSQL 数据库客户端,用于使用 Python 编程语言执行 CRUD 操作并管理 MongoDB 数据库中的数据。它作为一个数据库连接库,处理身份验证和连接池,同时还提供了一个用于管理嵌入索引并基于语义相似度检索数据的向量搜索客户端。 该驱动程序支持同步和异步数据库驱动模型,以执行非阻塞 I/O 操作并从数据库集群流式传输数据。它的独特之处在于专门的搜索能力,包括全文搜索和执行向量搜索以基于数学相似度检索数据。 其更广泛的能力涵盖数据存储和同步,包括多阶段聚合管道、索引生命周期管理和 BSON 二进制序列化。该库还实现了安全原语,如客户端字段级加密、TLS 连接安全以及与云身份提供商的集成。其他功能包括通过文件系统接口进行的大文件存储和实时数据变更监控。
Provides access to execution plans and performance statistics to optimize database query performance.
Kvrocks 是一个分布式键值存储和 Redis 兼容的 NoSQL 数据库。它利用 RocksDB 存储引擎提供基于磁盘的持久化,与内存系统相比,允许以更低的内存成本进行大容量数据存储。 该系统作为向量数据库和全文搜索引擎,支持对向量嵌入进行近邻搜索,并通过文本匹配进行复杂的文档查询。它采用无代理(proxyless)集群架构,通过基于槽位的路由来分发数据并在多个节点间扩展容量。 该平台涵盖了广泛的数据管理能力,包括 JSON 文档管理、时序数据和实时流处理。它通过地理空间查询、二级索引和查询计划分析提供高级搜索和索引功能,同时提供用于内存高效的基数和成员估计的概率数据草图。 其他操作特性包括原子事务、发布/订阅消息传递以及用于多租户环境的命名空间数据隔离。
Generates and analyzes query execution plans to optimize data retrieval and filtering.
Memgraph is an in-memory, distributed graph database designed for high-performance labeled property graph management. It utilizes a Cypher query engine for declarative data retrieval and manipulation, providing a scalable knowledge graph backend that integrates vector search and graph traversals. The system distinguishes itself as a real-time graph analytics platform, employing native C++ and CUDA implementations to execute complex network analysis and dynamic community detection on streaming data. It provides specialized support for AI integration, including GraphRAG capabilities, the constr
Generates detailed query execution plans to identify and resolve performance bottlenecks.
Kùzu is an embedded property graph database engine designed for high-performance analytical queries and local data management. It operates as a library within the host application process, utilizing a columnar-based storage architecture and just-in-time query compilation to execute complex graph traversals and pattern matching efficiently. By mapping database files directly into system memory, it ensures data durability and high-speed access while maintaining ACID-compliant transactional integrity. The engine distinguishes itself by integrating vector similarity search and full-text search di
Displays query execution plans to help developers optimize performance.
This project is a collection of specialized toolsets for SQL Server, functioning as a diagnostic toolkit, performance monitor, and database administrator framework. It provides stored procedures and utilities designed to automate backup recovery, diagnose system health, and optimize database performance and indexing. The kit distinguishes itself through specialized capabilities for point-in-time restoration and the calculation of estimated data loss windows using backup history. It also includes an index optimizer that analyzes usage and size to provide prioritized recommendations for data re
Implements tools to compare query execution plans and identify environmental discrepancies causing performance variations.
pgdog is a PostgreSQL sharding proxy, distributed SQL router, and connection pooler. It is designed to enable horizontal data distribution by splitting tables and indices across multiple independent servers to scale storage and processing capacity. The project distinguishes itself through online resharding capabilities, using logical replication to move data between shards without application downtime. It supports multiple routing strategies, including hash, list, and range-based query routing, and manages distributed atomic transactions using a two-phase commit process to ensure consistency
Retrieves and analyzes execution plans for slow queries to assist in performance tuning.
mcp-context-forge is a Model Context Protocol federation gateway that unifies diverse AI tool servers and APIs into a single consistent interface for discovery and execution. It acts as a centralized proxy that aggregates multiple servers and APIs, allowing AI agents to access and invoke a unified set of tools, prompts, and resources. The project distinguishes itself through a multi-protocol translation bridge that converts communication between standard I/O, SSE, gRPC, and REST to enable interoperability between disparate tool servers. It includes a comprehensive LLM evaluation framework for
Inspects database execution plans and table scan statistics to identify and optimize slow queries.