Awesome GitHub RepositoriesDatabase Performance Tuning

gh-ost is a triggerless online schema migration tool for MySQL. It functions as a replication client and table management utility that synchronizes data from a source table to a shadow table using binary logs, allowing for table structure modifications without locking original tables or causing downtime. The tool distinguishes itself by using binary-log-based replication instead of triggers to stream row-based events to a shadow table. It implements load-aware throttling and dynamic performance tuning to adjust migration speed based on server load and replication lag. Users can monitor and ad

MySQLTuner-perl is a diagnostic utility and Perl script designed for optimizing database configurations, auditing security, monitoring resources, and analyzing performance. It functions as a configuration optimizer and performance tuning tool that analyzes server variables to provide specific recommendations for increasing system stability and speed. The tool acts as a database auditor by evaluating security settings, SSL configurations, and schema integrity to identify vulnerabilities. It also serves as a resource monitor that forecasts capacity needs and calculates health scores based on di

This project is a comprehensive educational resource and curriculum focused on site reliability engineering, distributed systems, and infrastructure operations. It provides technical guides, a systems engineering course, and instructional manuals designed to teach the principles of managing large-scale computing environments. The curriculum covers high-level architectural design for scalability and resilience, including fault-tolerant infrastructure, high-availability patterns, and microservices decomposition. It emphasizes the practical application of site reliability engineering through the

Dieses Projekt ist ein Interview-Leitfaden für Backend-Engineering und eine Ressource für das Informatikstudium. Es bietet eine kuratierte Sammlung technischer Fragen und Antworten mit Fokus auf Server-Architektur, Datenbankoptimierung und Netzwerk-Grundlagen zur Vorbereitung auf professionelle Software-Engineering-Bewertungen. Die Ressource dient als technische Referenz für das Studium von ACID-Eigenschaften, Transaktionsisolation und der Optimierung relationaler und nicht-relationaler Systeme. Sie enthält eine Referenz zur Softwarearchitektur für die Analyse von Entwurfsmustern, Dependency Injection und den strukturellen Kompromissen verschiedener Backend-Frameworks. Der Inhalt deckt ein breites Spektrum technischer Bereiche ab, einschließlich Betriebssystemgrundlagen, Netzwerkprotokollstudien und Datenstrukturen. Zudem bietet es ein Handbuch für DevOps und Infrastruktur, das CI/CD-Pipelines, Container-Orchestrierung und Zero-Downtime-Deployment-Strategien detailliert beschreibt.

Pigsty is a comprehensive database infrastructure orchestration platform designed to automate the full lifecycle of high-availability PostgreSQL clusters. It functions as an infrastructure-as-code framework that manages cluster coordination, node provisioning, and service discovery through idempotent playbooks. By integrating distributed consensus mechanisms, the platform ensures automated failover and consistent state enforcement across diverse environments, including bare metal and virtualized infrastructure. The platform distinguishes itself through a robust suite of operational capabiliti

This project is a PostgreSQL Kubernetes operator and database orchestrator designed to automate the deployment, scaling, and lifecycle management of high-availability database clusters. It functions as a controller that uses declarative manifests to provision and synchronize the state of database instances within a cluster. The system manages high availability through streaming replication and ensures constant availability during maintenance via rolling updates. It also serves as a backup and recovery manager, handling point-in-time recovery, logical backups, and cluster cloning using cloud s

Pigsty is a full-stack orchestration suite for deploying, monitoring, and managing high-availability PostgreSQL clusters and their supporting infrastructure. It functions as a cluster management platform and high-availability suite that automates failover, manages virtual IPs, and ensures data consistency through distributed consensus. The project distinguishes itself by providing a comprehensive database infrastructure-as-code framework and a dedicated observability stack. It incorporates a backup and recovery manager supporting point-in-time recovery via S3-compatible object storage, alongs

Dieses Projekt ist ein umfassender Leitfaden und eine Sammlung bewährter Verfahren zum Testen von Node.js-Backend-Anwendungen. Es bietet eine kuratierte Reihe von Mustern und Referenzbeispielen zum Schreiben zuverlässiger Unit-, Integrations- und Komponententests. Das Projekt zeichnet sich durch spezifische Strategien für die Backend-Integration aus, einschließlich detaillierter Methoden für API-Vertragstests gegen OpenAPI-Spezifikationen und gemeinsame Schemata. Es bietet spezialisierte Anleitungen zum Testen von Message Queues mit Fokus auf Idempotenz, Resilienz und asynchrone Ereignissynchronisation. Der Leitfaden deckt ein breites Spektrum an Funktionsbereichen ab, einschließlich der Isolierung und Bereinigung des Datenbankzustands, dem Mocking externer Abhängigkeiten mittels Netzwerk-Interzeptoren und typsicheren Stubs sowie der Automatisierung containerisierter Testinfrastrukturen. Er befasst sich zudem mit der Leistungsoptimierung für Testsuiten durch die Verwendung von RAM-Disks und Memory-Engines für die Datenspeicherung.

This project is a collection of specialized toolsets for SQL Server, functioning as a diagnostic toolkit, performance monitor, and database administrator framework. It provides stored procedures and utilities designed to automate backup recovery, diagnose system health, and optimize database performance and indexing. The kit distinguishes itself through specialized capabilities for point-in-time restoration and the calculation of estimated data loss windows using backup history. It also includes an index optimizer that analyzes usage and size to provide prioritized recommendations for data re

pg_textsearch is a full-text search integration for PostgreSQL that provides large-scale text indexing and BM25 relevance ranking. It implements a scalable indexing architecture that uses a memtable system to spill data to disk segments, allowing for the processing of massive datasets. The project distinguishes itself through support for multilingual search via language-specific partial indexes and the ability to index complex expressions, such as JSONB fields or concatenated columns. It ensures high availability by utilizing PostgreSQL-native streaming replication and write-ahead logs to syn

SlateDB is a cloud-native key-value store and distributed database engine that utilizes a log-structured merge-tree architecture. It serves as a transactional storage layer designed to persist data directly to cloud object storage. The engine differentiates itself by optimizing read performance for remote storage through the use of bloom filters and multi-level block caching. It employs a single-writer multi-reader model and provides the ability to create zero-copy clones via copy-on-write checkpointing. The system supports atomic transactions, range queries, and snapshot-based concurrency c