2 مستودعات
Capabilities to switch between different distributed processing engines to optimize performance for specific workloads.
Distinct from Execution Engines: Focuses on the ability to target different distributed engines (like Flink, Spark) for the same pipeline.
Explore 2 awesome GitHub repositories matching data & databases · Multi-Engine Execution Backends. Refine with filters or upvote what's useful.
SeaTunnel is a distributed data integration engine designed to synchronize structured and unstructured data across diverse sources and sinks. It functions as a multi-engine execution framework that can run data integration tasks across different distributed computing backends to optimize workload performance. The project is distinguished by a visual data pipeline designer for configuring workflows without manual code and a specialized change data capture tool for streaming incremental database updates. It also includes an enrichment pipeline that integrates large language models and embedding
Supports running data integration tasks across various processing backends to optimize performance.
Apache Hive is a SQL-on-Hadoop data warehouse that enables querying and managing petabytes of data stored in distributed storage such as HDFS and cloud storage services. It provides a familiar SQL interface for batch analytics and reporting, supported by a core set of components including the HiveServer2 Thrift service for remote query execution, the Hive Metastore Service for central metadata management, the Hive ACID Transaction Engine for concurrent read-write operations, and the Hive LLAP Interactive Engine for low-latency analytical processing. The WebHCat REST API offers an HTTP interfac
Supports running Hive queries on Apache Spark for accelerated performance.