taskrabbit/elasticsearch-dump
Elasticsearch Dump
elasticsearch-dump is a command line tool for importing, exporting, and transferring data between Elasticsearch and OpenSearch instances. It functions as an index dump utility that saves documents, mappings, and analyzers to local files or standard output.
The tool enables the movement of data between clusters using local files as an intermediary and can flatten nested JSON documents into CSV files for external analysis. It allows for the modification or anonymization of documents during the transfer process through the use of custom JavaScript functions.
The utility covers data extraction and migration, supporting the backup of search indices and the synchronization of data between remote instances. It can resolve target indices using regular expressions and filter exported documents via search queries.
Features
- Search Index Exporters - Exports documents from a search instance to local files or transfers them to another instance.
- OpenSearch Index Administration - Moves documents, mappings, and configurations between OpenSearch clusters using local files as an intermediary.
- Bulk Index Export - Dumps data, mappings, and analyzers from multiple indices simultaneously to a local directory using regular expressions.
- Data Migration - Modifies or anonymizes documents using custom JavaScript functions during the migration process.
- Script-Based Transformations - Executes custom JavaScript scripts to modify or anonymize document fields during the data migration process.
- Data Transformation Scripts - Provides the ability to modify or anonymize documents during transfer using custom JavaScript functions.
- Document Filtering - Allows the use of search queries to filter and select specific subsets of documents for export.
- Elasticsearch Data Migration - Moves indices and mappings between different Elasticsearch or OpenSearch instances to migrate data to new environments.
- Search Index Backups - Saves documents and configurations from a search instance to local files to prevent data loss.
- Search Index Transfer - Moves indices, mappings, and analyzers between search instances and local files or standard I/O.
- Search Indexing Utilities - Loads documents from local files or remote instances into target search indices.
- Database Migration Tools - A command line tool for importing, exporting, and transferring data between Elasticsearch and OpenSearch instances.
- Index Dump Utilities - Exports Elasticsearch indices, mappings, and analyzers to local files or standard output.
- JSON to CSV Conversion - Transforms JSON search documents into CSV format by flattening nested data structures.
- OpenSearch Exporters - Exports data from OpenSearch indices into portable formats for use in other systems.
- Data Exporters - Saves specific subsets of search data to various file formats based on search queries.
- Memory-Efficient Data Streaming - Processes documents in sequential chunks to move data without overloading system memory.
- Elasticsearch Exporters - Exports specific Elasticsearch documents to CSV or JSON files for offline analysis.
- Index Pattern Matching - Identifies target indices for export by matching index names against regular expression patterns.
- Flattening Converters - Provides utilities to flatten hierarchical JSON documents into line-based representations for CSV compatibility.
- Multi-Destination Data Routing - Directs data streams to local files, standard output, or remote search instances using a unified interface.
- Search Index Synchronizers - Transfers data between remote search instances while applying custom filters and transformations.
- Databases & Data - Tools for saving and moving indices.
