mydumper/mydumper
Mydumper
MyDumper is a high-performance logical backup and migration tool for MySQL. It provides utilities for executing parallel exports and imports of database data, enabling the creation of consistent point-in-time snapshots for large-scale environments.
The tool distinguishes itself through multi-threaded parallel processing for both backup and restoration. It utilizes chunk-based logical partitioning and transaction-based snapshot isolation to ensure data consistency across multiple exported files while reducing the total time required to handle large datasets.
The system includes capabilities for selective database exports using a regular expression filter engine to include or exclude specific targets. These features support large-scale data migration between MySQL instances by dividing tables into smaller segments for concurrent processing.
Features
- Parallel Data Exports - Utilizes concurrent worker threads to export database tables in parallel, significantly reducing backup windows for large datasets.
- Point-In-Time Snapshots - Ensures point-in-time consistency across exported files using global read locks and transaction isolation.
- Logical Backups - Generates portable logical backups of databases using parallel processing to efficiently handle large datasets.
- MySQL - Provides high-performance, consistent logical backups for MySQL databases using parallel processing.
- Database Backup Restoration - Implements a parallelized restoration process to import logical backups into a destination database.
- MySQL Server Restorations - Reconstructs MySQL servers from logical backups using multiple threads to minimize downtime during recovery.
- Parallel Restore Utilities - Imports logical backups into MySQL databases using multiple threads to significantly reduce recovery time.
- Point-in-Time Database Snapshots - Manages consistent point-in-time database snapshots by coordinating global read locks and transaction IDs during export.
- Database Backups - Creates multi-threaded logical backups of databases to minimize the time required for large-scale data preservation.
- Logical Database Dumps - Provides a mechanism to serialize database records into discrete text files to enable granular recovery and parallelization.
- MySQL Administration Tools - Serves as a high-performance administrative tool for exporting and importing MySQL databases.
- Parallel Export Utilities - Creates consistent point-in-time snapshots of MySQL data using multi-threaded logical backup operations.
- Parallel Data Imports - Accelerates database recovery by loading multiple logical backup files concurrently into the destination server.
- Logical Data Partitioning - Implements logical data partitioning by dividing large tables into smaller segments using primary key ranges for parallel processing.
- Cross-Database Data Migrations - Facilitates the movement of massive datasets between MySQL instances via parallelized logical export and import operations.
- Database Record Exports - Allows for the extraction of specific tables or databases using regular expression patterns to define the export scope.
- MySQL Data Migration Tools - Enables the migration of large datasets between MySQL instances using parallelized logical export and import.
- Backup Filters - Provides a filtering utility to include or exclude specific databases and tables from the backup scope using regular expressions.
- Backup and Recovery - Executes high-performance logical, parallel backups.
