NLPchina/elasticsearch-sql
Elasticsearch Sql
This project provides a SQL interface for Elasticsearch, serving as a translator and database layer that allows users to retrieve, filter, and manipulate indices using structured query language. It functions by converting standard SQL statements into the native JSON query language used by the search engine.
The system includes a geospatial SQL engine for executing location-based searches and distance calculations. It also features a query debugger used to visualize the translation process from SQL to search engine request bodies to verify the logic and accuracy of data retrieval.
The capability surface covers data retrieval and record management, including the deletion of specific data entries. It further supports data analysis through large-scale aggregations, statistical summaries, and data transformations using conditional logic and mathematical functions.
Features
- Native Query Translation - Translates structured SQL statements into the native JSON query language used by the search engine.
- Schema Mapping - Matches SQL table and column identifiers to specific search engine indices and field names.
- Elasticsearch Connectors - Provides a database layer for retrieving, filtering, and manipulating Elasticsearch indices using SQL.
- SQL Data Analysis - Performs aggregations and statistical summaries on large datasets using SQL to gain insights from stored information.
- Dataset Aggregations - Produces grouped results and statistical insights from large datasets using SQL aggregation functions.
- Search-Oriented SQL Engines - Implements a query interface for executing location-based searches and distance calculations using SQL extensions.
- Dynamic SQL Generators - Programmatically builds search engine request bodies at runtime based on parsed SQL expressions.
- Geospatial and Location Services - Executes location-based queries using bounding box checks, distance calculations, and geohash grid aggregations.
- SQL Geospatial Analysis - Executes location-based searches and distance calculations on spatial data using SQL extensions.
- Geospatial Query Mapping - Translates standard SQL spatial functions into specialized geographic query filters and distance calculations.
- Geospatial Search - Retrieves data based on coordinate locations and spatial relationships using specialized search extensions.
- Search-Oriented SQL Interfaces - Provides a standard SQL syntax to retrieve and filter data from Elasticsearch indices.
- SQL Data Retrieval - Provides the ability to retrieve, filter, sort, and group data from indices using standard SQL syntax.
- Data Transformation Functions - Provides conditional logic, string manipulation, and mathematical functions to reshape data for final delivery.
- Grouped Aggregations - Maps SQL grouping and summary functions to nested aggregation buckets for large-scale data analysis.
- Query Middleware - Acts as an intermediary layer that intercepts SQL requests and forwards translated queries to the search cluster.
- Query Translators - Translates SQL statements into native search engine queries to verify the logic and accuracy of data retrieval.
- Query Translation Debuggers - Provides a utility for visualizing the translation process from SQL statements to search engine request bodies.
- More to explore - Plugin to query Elasticsearch using SQL syntax.
