trinodb/trino
Trino
Trino is a distributed SQL query engine designed for large-scale data analytics. It functions as a data federation platform, providing a unified interface that allows users to execute complex analytical queries across multiple heterogeneous data sources simultaneously without requiring data movement or transformation.
The engine utilizes a massively parallel processing architecture to scale compute resources across clusters for high-speed data retrieval. It distinguishes itself through a cost-based query optimizer that analyzes metadata to determine efficient execution plans, alongside dynamic filtering propagation that reduces data movement by applying constraints directly to upstream sources.
The platform incorporates a comprehensive security framework that enforces granular, centralized authentication and authorization policies across all connected schemas. It also supports fault-tolerant task scheduling, which manages query state in persistent storage to enable automatic recovery from node or process failures during long-running analytical jobs.
Features
- Distributed SQL Engines - Operates as a distributed SQL query engine for high-performance analytical processing across heterogeneous sources.
- Federated Data Gateways - Acts as a data federation platform that connects disparate storage systems for unified analytical access.
- Federated Data Query Engines - Enables federated querying across multiple disparate data sources without requiring data movement or transformation.
- Data Analytics Engines - Functions as a high-performance engine for distributed data analytics and large-scale reporting.
- Parallel Processing - Utilizes a massively parallel processing engine to scale compute resources for high-speed data retrieval.
- External Data Connectors - Provides a connector-based architecture to integrate and query diverse external data sources through a unified interface.
- Cost-Based Optimizers - Utilizes cost-based optimization to analyze metadata and statistics for generating efficient query execution plans.
- Access Control Systems - Provides an enterprise access control system for centralized authentication and authorization across data schemas.
- Access Control - Enforces granular access control policies to restrict user access to specific data sets and schemas.
- Data Pipelines and Orchestration - Fast distributed SQL query engine for large-scale data analytics.
- Databases and Analytics - Distributed SQL query engine for big data.
- Query Engines - Distributed engine for querying large, heterogeneous data sets.
- Data Engineering - Distributed SQL query engine for fast analytic queries.
- Java Projects - Listed in the “Java Projects” section of the Awesome For Beginners awesome list.
- Dynamic Filtering - Implements dynamic filtering to push constraints to upstream sources and minimize data movement during query execution.
- Enterprise Security Controls - Ensures enterprise data security through centralized authentication and authorization across the organization.
- Fault Tolerance - Supports fault-tolerant task scheduling to ensure query resilience and automatic recovery from node failures.
- Fault-Tolerant Workflow Execution - Provides fault-tolerant execution to automatically recover and resume long-running analytical queries after node interruptions.
- Security Providers - Integrates pluggable security providers to enforce centralized authentication and authorization policies across data sources.
