zombodb/zombodbArchived
Zombodb
Zombodb es una extensión de base de datos e indexador de datos relacionales que integra PostgreSQL con Elasticsearch. Proporciona una interfaz de búsqueda SQL, permitiendo a los usuarios ejecutar consultas de búsqueda complejas y agregaciones utilizando funciones y sintaxis SQL estándar en lugar de APIs JSON nativas. El proyecto sincroniza datos relacionales de PostgreSQL a un motor de búsqueda remoto para habilitar la búsqueda de texto completo y analítica de alto rendimiento.
El sistema se distingue por tender un puente entre estructuras relacionales y capacidades de motores de búsqueda, específicamente mediante la integración de búsqueda geoespacial para tipos de geometría y geografía. Implementa una capa de mapeo de consultas SQL-a-JSON que permite un análisis de texto avanzado —incluyendo coincidencia difusa, búsquedas de proximidad y puntuación de relevancia— directamente dentro de un entorno relacional.
El proyecto cubre áreas de capacidad amplias, incluyendo la gestión del ciclo de vida de índices, sincronización automatizada de datos relacionales y agregaciones analíticas complejas. Soporta indexación espacial para consultas basadas en ubicación, tuberías de análisis de texto personalizadas y herramientas de monitoreo para auditar estadísticas de índices y salud del clúster. La seguridad se maneja mediante conexiones cifradas entre la base de datos y el motor de búsqueda usando TLS.
Features
- Elasticsearch Integrations - Provides a specialized integration that synchronizes PostgreSQL relational data with Elasticsearch for high-performance search.
- Search-Oriented SQL Engines - Provides a search-oriented SQL engine to execute complex full-text and aggregate queries against an external search backend.
- Search-Oriented SQL Interfaces - Provides an SQL interface allowing advanced search engine queries and aggregations to be executed using standard SQL syntax.
- Data Type Mappings - Converts relational data types into compatible search engine mappings for efficient indexing.
- Aggregate SQL Statisticians - Computes complex statistics and distributions on relational data using a search engine framework via SQL queries.
- Full Text Search - Adds complex text search capabilities including fuzzy matching, proximity searches, and highlighting to a relational database.
- Geospatial Search - Provides capabilities for filtering data based on geographic shapes and bounding boxes.
- Geospatial Search - Indexes and searches geometry and geography types to enable location-based queries.
- Relational Data Indexers - Implements an automated indexer that maps PostgreSQL tables to a remote search engine to enable complex analytics.
- Table-to-Index Associations - Identifies and associates specific search indices with given database tables, views, or relations.
- Relational-to-Search Mappings - Maps database table schemas and data types to search engine mappings and text analysis pipelines.
- Search Index Synchronizers - Maintains real-time consistency between PostgreSQL tables and remote Elasticsearch indices via automatic row change indexing.
- Search and Indexing - Indexes table columns into a search engine to enable complex SQL-based queries and aggregations.
- Search Engine Integrations - Integrates relational data with external search engines to enable advanced analytics via SQL.
- Geospatial Search - Bridges PostgreSQL geometry and geography types to enable location-based queries in Elasticsearch.
- Spatial Indexing - Implements storage and indexing of geographic shapes and coordinates to enable spatial analysis.
- SQL-to-Search Function Mapping - Builds type-checked search queries using a library of functions that map to search engine operations.
- SQL-to-JSON Query Translation - Translates relational SQL statements into JSON-formatted requests for an external search engine backend.
- Arbitrary Aggregation Executions - Allows the execution of any supported search aggregation request, returning the result as a flexible JSON blob.
- Complex Data Serialization - Enables defining custom functions to convert complex relational data types into JSON for search index storage.
- Statistical Aggregators - Generates JSON for advanced statistical analysis, including box plots, percentiles, and median absolute deviation.
- Data Analytics Engines - Performs complex aggregations and statistical distributions on database tables using an external search engine.
- Geospatial Metric Aggregations - Provides geographic analysis capabilities, such as computing bounding boxes and weighted centroids for coordinate fields.
- Polygon and Box Filters - Filters records using polygon and bounding box queries to identify intersecting geometry.
- Cross-Index Join Optimizations - Improves performance for complex queries spanning multiple indices via coordination with a search accelerator.
- Multi-Language Search Support - Assigns language-specific tokenizers and analyzers to columns to enable localized full-text search.
- Query Result Size Estimators - Predicts row counts for search queries to optimize database execution plans and index scan efficiency.
- Cross-Index Join Coordination - Implements field mapping to simulate relational joins across multiple search indices during query execution.
- Search Index Schemas - Automatically generates search index mappings from relational table schemas, supporting nested objects.
- Search Engine API Projections - Exposes search engine API endpoints as typed views and functions directly within the PostgreSQL environment.
- Search Index Management - Manages the creation, modification, and deletion of full-text search indices using SQL statements.
- Nested Object Queries - Provides the ability to filter documents based on multiple complex criteria within a single nested object.
- Functional Data Transformations - Transforms relational data via custom functions to concatenate fields or embed related data as nested objects.
- Text Search Query Executions - Executes complex text searches using boolean operators, phrases, and fuzzy matching within SQL.
- Proximity Text Matching - Finds documents where specific words or phrases appear within a defined distance of each other.
- Search-Only Fields - Allows setting specific mapping properties and creating search-only fields for table columns.
- Cross-Index Joining - Links multiple search indices together via field mappings to enable queries across normalized tables.
- Aggregation-based Filter Definitions - Creates JSON for aggregations that group documents based on specific filters, labels, or adjacency matrices.
- Search Result Sorting - Controls the order and quantity of search results returned from the search engine for performance.
- Single-Value Metric Computations - Calculates numeric summaries such as averages, minimums, or document counts based on query filters.
- Aggregation Table Generators - Transforms multi-bucket search aggregation results into relational table formats for SQL output.
- Numeric Range Bucketing - Constructs JSON for bucket-based aggregations that group data by numeric ranges or time intervals.
- Value-Based Bucket Aggregations - Constructs JSON for dynamic buckets based on unique field values, IP ranges, or geospatial grids.
- Search Snippet Generation - Returns relevant snippets of matching text and calculates relevance scores for search results.
- Text Tokenization Pipelines - Creates tailored tokenizers, filters, and normalizers to control how text is processed and indexed.
- Metric Aggregations - Constructs JSON for calculating single or multi-value numeric metrics like sums, averages, minimums, and maximums.
- Aggregation Pipeline Definitions - Constructs complex JSON structures for bucket-based analytics and statistical distributions processed by the search cluster.
- Relevance Scoring - Calculates and returns numerical relevance scores for matching rows to enable sorting by relevance.
- Relevance Score Boosting - Applies floating-point boost values to specific terms or fields to refine result weight and ranking.
- Search and Indexing - PostgreSQL extension for creating indices backed by search engines.
- Extensions and Plugins - Full-text search extension backed by Elasticsearch.
