tair-opensource/RedisShake
RedisShake
RedisShake este un instrument de migrare și sincronizare pentru instanțele Redis și Valkey. Acesta facilitează transferul de date între deployment-uri de tip standalone, sentinel și cluster, acționând ca un migrator de baze de date cross-version și ca utilitar pentru restaurarea datelor din fișiere de backup.
Proiectul oferă un pipeline programabil de transformare a datelor care permite filtrarea cheilor, remaparea indicilor bazelor de date și executarea de scripturi Lua pentru a modifica comenzi și chei în timpul tranzitului. Suportă sincronizarea fără downtime prin replicarea snapshot-urilor și streaming-ul modificărilor incrementale în timp real.
Instrumentul acoperă o gamă largă de metode de extracție, inclusiv migrarea bazată pe replicare, migrarea bazată pe scanare și restaurarea din fișiere de backup. Include capabilități pentru descoperirea nodurilor de cluster, rezoluția master-ului sentinel și verificarea compatibilității versiunilor pentru a asigura stabilitatea în timpul transferurilor între versiuni diferite.
Features
- Redis Data Migration Tools - Moves data between Redis or Valkey instances across different deployment types and versions with minimal service interruption.
- Redis Database Migration Tools - Transfers data between Redis or Valkey instances across standalone, sentinel, and cluster deployments.
- Database Backup Restoration - Loads data from RDB files or backup snapshots into a live Redis or Valkey instance to recover system state.
- Slave-Simulation Synchronization - Synchronizes data from a source node by simulating a slave to receive and replay snapshots and incremental streams.
- Zero-Downtime Migrations - Transfers data between instances without service interruption or data loss to ensure continuous operation.
- Replication-Based Migration - Synchronizes data from a source instance by mimicking a slave node using replication protocols to ensure minimal downtime.
- Real-Time Data Replication - Replicates data in real-time using replication protocols to move datasets without service interruption.
- Database Version Migrations - Moves data across different database versions by supporting a wide range of base data types and modules.
- Hybrid Data Extraction - Retrieves data from source instances using synchronization, backup files, or scanning methods to facilitate migration.
- Incremental Data Synchronization - Subscribes to keyspace notifications to detect and migrate modifications in real-time to prevent data loss.
- Cluster Topology Management - Transfers datasets between complex Redis cluster configurations by automatically discovering topology and resolving master nodes.
- Redis Database Synchronization - Maintains data parity between instances by replicating snapshots and streaming incremental changes in real time.
- Cluster Topology Discovery - Identifies and connects to all nodes in a cluster by querying the network topology.
- Command Filtering - Provides the ability to block specific commands or groups to prevent incompatible operations from reaching the target instance.
- Command and Key Rewriting - Executes custom Lua logic to rewrite commands, split multi-key operations, or modify key prefixes before writing to the destination.
- Migration Key and Command Rewriting - Provides Lua-based logic to rewrite commands and modify key prefixes during data transit.
- Database Backup Restorations - Rdb-tools loads and migrates data directly from a backup file to a target instance.
- Database Index Filtering - Restricts the synchronization process to specific database indices to control the scope of the migration.
- Database Index Remapping - Changes the destination database index for incoming data to move source databases to different target indices.
- Sentinel Clients - Retrieves the current master node address from a sentinel instance to establish a connection to the primary data source.
- Rule-Based Data Filtering - Drops specific keys, database indices, or data structure types based on custom business logic to control migrated content.
- Scan-Based Migration - Iterates through all keys in a source instance to migrate data when replication protocols are unavailable.
- Migration Transformation Pipelines - Ships a programmable pipeline to filter keys and remap database indices during data transfer.
- Database Version Compatibility - Checks for breaking changes and bugs when migrating data between different major versions of a database to ensure stability.
- Pattern-Based Key Filtering - Enables excluding or including specific data keys using matches, prefixes, or regular expressions to ensure only desired records are migrated.
