2 Repos
Awesome GitHub RepositoriesMetadata-Driven Data Skipping
Filtering techniques that use file statistics and partition predicates in metadata to avoid reading irrelevant files.
Distinct from Data Filtering: Specifically uses metadata for I/O reduction (data skipping) rather than record-level filtering for visualization.
Explore 2 awesome GitHub repositories matching data & databases · Metadata-Driven Data Skipping. Refine with filters or upvote what's useful.
Awesome Metadata-Driven Data Skipping GitHub Repositories
Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
- delta-io/delta
delta-io/delta
8,596Auf GitHub ansehenDelta is a lakehouse table format that brings ACID transactions and data warehouse consistency to large scale data lakes on cloud object storage. It serves as an ACID transaction manager, coordinating atomic commits and serializable isolation for concurrent reads and writes across distributed compute engines. The project provides a multi-engine interoperability layer that uses format translation to allow diverse SQL engines and processing frameworks to read and write the same tables. It functions as a data versioning system, utilizing a transaction log to enable time travel, historical snapsh
Scans metadata files using predicates to identify specific data partitions or files to optimize query performance.
Scalaacidanalyticsbig-data - greptimeteam/greptimedb
GreptimeTeam/greptimedb
5,968Auf GitHub ansehenGreptimeDB is a distributed, open-source time-series database built for unified observability. It stores and queries metrics, logs, and traces together in a single columnar engine, supporting both SQL and PromQL for analysis. The database is designed as a Kubernetes-native operator with a decoupled compute and storage architecture, enabling horizontal scaling and multi-region deployment. What distinguishes GreptimeDB is its role as a multi-protocol ingestion gateway, accepting data through OpenTelemetry, Prometheus Remote Write, InfluxDB, Loki, Elasticsearch, Kafka, and MQTT protocols without
Maintains metadata about value ranges per data block, allowing the query engine to skip blocks that cannot contain matching rows.
Rustanalyticscloud-nativedatabase
