2 repository-uri
Interfaces that allow diverse compute frameworks to maintain a consistent view of the same table format.
Distinct from Table Format Integrations: Distinct from Table Format Integrations: focuses on the ability to connect multiple different query engines to a single consistent interface.
Explore 2 awesome GitHub repositories matching data & databases · Multi-Engine Interfaces. Refine with filters or upvote what's useful.
Iceberg is an open table format and big data table manager designed for huge analytic datasets in cloud storage. It provides a specification for tracking large-scale datasets to maintain transactional consistency and structural integrity. The project utilizes a standardized REST catalog interface to manage table metadata, ensuring interoperability between different compute engines. This allows diverse query engines to connect to a single table interface and maintain consistency across different processing frameworks. Its core capabilities include managing large-scale analytic tables, coordin
Connects diverse compute frameworks to maintain a consistent table interface regardless of the underlying processing engine.
Delta is a lakehouse table format that brings ACID transactions and data warehouse consistency to large scale data lakes on cloud object storage. It serves as an ACID transaction manager, coordinating atomic commits and serializable isolation for concurrent reads and writes across distributed compute engines. The project provides a multi-engine interoperability layer that uses format translation to allow diverse SQL engines and processing frameworks to read and write the same tables. It functions as a data versioning system, utilizing a transaction log to enable time travel, historical snapsh
Employs a consistent kernel and set of APIs to allow diverse query engines to read and write open table formats.