11 个仓库
Techniques and utilities for optimizing database resource usage, query throughput, and system stability during operations.
Distinct from Performance Tuning: The candidates are either too generic, focused on AI, or specifically targeted at connection pools, whereas this is about overall database operational tuning.
Explore 11 awesome GitHub repositories matching data & databases · Database Performance Tuning. Refine with filters or upvote what's useful.
gh-ost is a triggerless online schema migration tool for MySQL. It functions as a replication client and table management utility that synchronizes data from a source table to a shadow table using binary logs, allowing for table structure modifications without locking original tables or causing downtime. The tool distinguishes itself by using binary-log-based replication instead of triggers to stream row-based events to a shadow table. It implements load-aware throttling and dynamic performance tuning to adjust migration speed based on server load and replication lag. Users can monitor and ad
Implements dynamic adjustment of chunk sizes and sleep ratios to balance migration speed with database stability.
MySQLTuner-perl is a diagnostic utility and Perl script designed for optimizing database configurations, auditing security, monitoring resources, and analyzing performance. It functions as a configuration optimizer and performance tuning tool that analyzes server variables to provide specific recommendations for increasing system stability and speed. The tool acts as a database auditor by evaluating security settings, SSL configurations, and schema integrity to identify vulnerabilities. It also serves as a resource monitor that forecasts capacity needs and calculates health scores based on di
Analyzes database configuration variables to provide recommendations that increase speed and system stability.
This project is a comprehensive educational resource and curriculum focused on site reliability engineering, distributed systems, and infrastructure operations. It provides technical guides, a systems engineering course, and instructional manuals designed to teach the principles of managing large-scale computing environments. The curriculum covers high-level architectural design for scalability and resilience, including fault-tolerant infrastructure, high-availability patterns, and microservices decomposition. It emphasizes the practical application of site reliability engineering through the
Teaches techniques for adjusting database server and client parameters to optimize resource usage and stability.
本项目是一个后端工程面试指南和计算机科学学习资源。它提供了一系列精选的技术问题和答案,专注于服务器端架构、数据库优化和网络基础知识,为专业软件工程评估做准备。 该资源作为学习 ACID 属性、事务隔离以及关系型和非关系型系统优化的技术参考。它包含用于分析设计模式、依赖注入以及各种后端框架结构权衡的软件架构参考。 内容涵盖了广泛的技术领域,包括操作系统基础、网络协议研究和数据结构。它还提供了 DevOps 和基础设施手册,详细介绍了持续集成流水线、容器编排和零停机部署策略。
Includes educational content on optimizing data retrieval via indexing and transaction isolation levels.
Pigsty 是一个全面的数据库基础设施编排平台,旨在自动化高可用 PostgreSQL 集群的全生命周期。它作为一个基础设施即代码(IaC)框架,通过幂等 Playbook 管理集群协调、节点配置与服务发现。通过集成分布式共识机制,该平台确保了在包括裸机与虚拟化基础设施在内的多样化环境中,自动化故障转移与一致的状态强制执行。 该平台通过一套超越标准数据库管理的强大运营能力脱颖而出。它具备内置的观测流水线,将指标、日志与追踪聚合到集中式仪表盘中,用于实时性能监控与诊断分析。此外,它还提供了一个模拟专有线路协议与 SQL 语法的迁移框架,允许将遗留企业数据库工作负载集成到现代关系型环境中。 该系统涵盖了广泛的功能面,包括带有写时复制(CoW)克隆以实现快速部署的高级存储管理,以及协调关系型引擎与缓存及对象存储服务的多数据库编排。它还整合了安全加固、自动化备份与恢复,以及通过分层代理进行的流量路由,以将客户端连接与底层集群拓扑解耦。 该项目以自包含的包镜像模型分发,能够在安全或离线环境中实现一致的部署与依赖管理。
Tunes configuration parameters at the cluster, instance, or user level to optimize performance.
This project is a PostgreSQL Kubernetes operator and database orchestrator designed to automate the deployment, scaling, and lifecycle management of high-availability database clusters. It functions as a controller that uses declarative manifests to provision and synchronize the state of database instances within a cluster. The system manages high availability through streaming replication and ensures constant availability during maintenance via rolling updates. It also serves as a backup and recovery manager, handling point-in-time recovery, logical backups, and cluster cloning using cloud s
Offers database performance tuning via sidecar containers and storage volume resizing.
Pigsty is a full-stack orchestration suite for deploying, monitoring, and managing high-availability PostgreSQL clusters and their supporting infrastructure. It functions as a cluster management platform and high-availability suite that automates failover, manages virtual IPs, and ensures data consistency through distributed consensus. The project distinguishes itself by providing a comprehensive database infrastructure-as-code framework and a dedicated observability stack. It incorporates a backup and recovery manager supporting point-in-time recovery via S3-compatible object storage, alongs
Applies pre-defined tuning templates optimized for OLTP or OLAP workloads to maximize throughput.
该项目是 Node.js 后端应用测试的最佳实践综合指南和集合。它提供了一套精选的模式和参考示例,用于编写可靠的单元测试、集成测试和组件测试。 该项目通过特定的后端集成策略脱颖而出,包括针对 OpenAPI 规范和共享模式进行 API 合约测试的详细方法。它提供了关于管理消息队列测试的专业指导,重点关注幂等性、弹性和异步事件同步。 该指南涵盖了广泛的能力领域,包括数据库状态隔离和清理、通过网络拦截器和类型安全存根进行的外部依赖模拟,以及容器化测试基础设施的自动化。它还通过使用 RAM 磁盘和内存引擎进行数据存储,解决了测试套件的性能优化问题。
Provides guidance on tuning database configuration flags to prioritize execution speed over durability during test runs.
This project is a collection of specialized toolsets for SQL Server, functioning as a diagnostic toolkit, performance monitor, and database administrator framework. It provides stored procedures and utilities designed to automate backup recovery, diagnose system health, and optimize database performance and indexing. The kit distinguishes itself through specialized capabilities for point-in-time restoration and the calculation of estimated data loss windows using backup history. It also includes an index optimizer that analyzes usage and size to provide prioritized recommendations for data re
Identifies resource-intensive queries and optimizes database indexes to improve system throughput.
pg_textsearch is a full-text search integration for PostgreSQL that provides large-scale text indexing and BM25 relevance ranking. It implements a scalable indexing architecture that uses a memtable system to spill data to disk segments, allowing for the processing of massive datasets. The project distinguishes itself through support for multilingual search via language-specific partial indexes and the ability to index complex expressions, such as JSONB fields or concatenated columns. It ensures high availability by utilizing PostgreSQL-native streaming replication and write-ahead logs to syn
Optimizes query speeds through segment consolidation, memory management, and skipping irrelevant data blocks.
SlateDB is a cloud-native key-value store and distributed database engine that utilizes a log-structured merge-tree architecture. It serves as a transactional storage layer designed to persist data directly to cloud object storage. The engine differentiates itself by optimizing read performance for remote storage through the use of bloom filters and multi-level block caching. It employs a single-writer multi-reader model and provides the ability to create zero-copy clones via copy-on-write checkpointing. The system supports atomic transactions, range queries, and snapshot-based concurrency c
Allows tuning of performance trade-offs between API request costs, durability latency, and cache utilization.