wal-g/wal-g

Features

• Cloud Database Archiving - Archives database files and logs to cloud storage providers to ensure long-term data durability.
• Database Backup and Restore - Provides a comprehensive system for creating and restoring database backups to prevent data loss using cloud storage.
• Cloud Storage Backups - Archives database files and transaction logs to cloud storage providers to ensure long-term data durability.
• Backup Inventories - Maintains a metadata-driven record of backup snapshots and log ranges to automate retention and pruning.
• Backup Stream Extraction - Downloads specified backups as decrypted streams and assembles split parts locally for restoration.
• Base Backup Retrieval - Retrieves a specific or the latest base backup from cloud storage and extracts it locally.
• Binary Log Archiving - Sends database binary logs to storage and filters for new events to support master switchovers.
• Binary Log Replay - Fetches binary logs from storage and executes commands to apply changes to a database server.
• Binary Log Retrieval - Retrieves binary logs from storage based on backup names and timestamps to facilitate point-in-time recovery.
• Cloud Storage Integrations - Integrates with cloud providers, local filesystems, and remote hosts to store database archives and logs.
• Cluster Restorations - Retrieves base backups and restores them to a database cluster using specific restore points.
• Database Backup Management - Implements automated backup pruning and retention policies to manage storage capacity and backup lifecycles.
• Disaster Recovery Workflows - Facilitates disaster recovery by storing base backups and transaction logs in remote cloud locations.
• Database Backups and Restores - Tools for archiving and restoring database state and transaction logs to cloud storage for disaster recovery.
• Write-Ahead Logging Configurations - Uploads write-ahead log files to storage and tracks completeness to prevent redundant transfers.
• Database Recovery - Restores specific databases or the entire server from named backups with optional renaming for flexible recovery.
• Cloud Storage Restorations - Retrieves archived snapshots and transaction logs from cloud storage to reconstruct a database.
• Backup Log Application - Fetches archived operation logs and applies them to a database instance to enable point-in-time recovery.
• Transaction Log Archiving - Captures a continuous stream of database operation logs and pushes them to remote storage.
• Log Retrieval - Provides the ability to retrieve specific write-ahead logs created after a backup to enable point-in-time recovery.
• Log Sequence Tracking - Tracks write-ahead log sequences by their identifiers to enable consistent point-in-time recovery.
• Log Streaming - Streams log files from segment primaries to cloud storage to facilitate point-in-time recovery.
• WAL Archivers - Captures and pushes write-ahead logs to remote storage to enable point-in-time recovery.
• WAL Archiving - Uploads write-ahead log archives to storage to enable precise point-in-time recovery.
• Cloud Backups - Provides a comprehensive manager for compressing, encrypting, and pruning database backups in cloud storage.
• Point-in-Time Recovery - Restores database states to specific historical moments by replaying archived write-ahead and binary logs.
• WAL Streaming - Receives a log stream using replication and pushes it directly to storage for continuous data capture.
• Base Backup Uploads - Uploads the database data directory to cloud storage using direct filesystem reads or streaming protocols.
• Remote Backup Storage - Creates new database backups and uploads them directly to remote storage providers.
• Client-Side Encryption - Secures database backups by encrypting data streams locally before transmission to cloud storage.
• Encrypted Backups - Compresses and encrypts database backup streams to ensure data is secured and optimized for long-term cloud storage.
• Cloud Provider Abstractions - Provides a storage interface that abstracts backup operations across different cloud provider APIs and local filesystems.
• Backup & Disaster Recovery - Archives database state and transaction logs to remote cloud storage to facilitate full disaster recovery.
• Backup Snapshot Managements - Manages backup snapshots by listing available versions, retrieving metadata, and deleting specific snapshots.
• Full and Delta Backups - Generates both full and delta backups of the database cluster and pushes them to cloud storage.
• Immutable Backups - Allows marking backups as permanent to prevent deletion and ensures necessary parent backups are also protected.
• Backup Purging - Removes backups and logs based on retention counts or timestamps to manage storage capacity.
• Permanence Configuration - Enables marking specific backups as permanent to protect them from automated cleanup processes.
• Binary Log Streaming Tools - Runs a server that fetches binary logs from storage and streams them to slave databases for replication.
• Backup Directory Listing - Retrieves names and creation times of existing backups from storage for recovery planning.
• Backup Compression - Reduces backup file sizes using industry-standard compression algorithms to save cloud storage space.
• Partial Restorations - Restores only specific databases or tables from a backup instead of the entire cluster.
• Backup Streaming - Creates database backups via streaming commands and sends the data directly to cloud storage.
• Restore Point Listing - Retrieves a list of available restore points from storage in human-readable or machine-readable formats.
• Log Purging - Removes old transaction log archives while retaining those necessary for point-in-time recovery.
• Database Incremental Backups - Generates incremental backups based on specific log sequence numbers to synchronize lagging replicas.
• Backup Pruning - Removes outdated backups from storage based on specified dates or maximum version counts.
• Streaming Restorations - Downloads specified backups from remote storage and streams the data directly to a restoration command.
• Database State Rewinding - Retrieves missing log segments from storage required to perform a database rewind operation.
• Streaming Data Pipelines - Processes database backups through a sequence of compression and encryption transforms via a streaming pipeline.
• Backup and Recovery - Modern, high-performance successor for cloud-based archiving.

Star history