2 Repos
Columnar query engines embedded directly within the database to run analytical SQL workloads on live data.
Distinct from Columnar Analytics: Distinct from Columnar Analytics: focuses on the embedded engine architecture within the database, not general columnar query capabilities.
Explore 2 awesome GitHub repositories matching data & databases · In-Database Columnar Engines. Refine with filters or upvote what's useful.
Apache DataFusion is an extensible, columnar SQL query engine that runs embedded within a host application without requiring a separate server process. It processes data in columnar batches using Apache Arrow for memory-efficient analytics, and can scale analytic workloads across multiple nodes for parallel execution. The engine supports both SQL and DataFrame queries through a modular, streaming architecture that allows custom operators, data sources, functions, and optimizer rules. The engine distinguishes itself through its modular extension framework, which enables building custom query e
Processes data in Arrow columnar batches through a streaming pipeline without materializing intermediate results.
AliSQL is a fork of MySQL by Alibaba that extends the relational database management system with enhancements for high performance, scalability, and enterprise-grade availability. It retains the core MySQL identity as a SQL-based database for storing, organizing, and retrieving structured data, while adding optimizations for large-scale transactional and analytical workloads. The project differentiates itself through a set of Alibaba-specific improvements, including a columnar engine for accelerating analytical queries directly on MySQL tables, and a distributed, shared-nothing NDB Cluster en
MySQL executes analytical SQL workloads directly on a columnar storage engine, accelerating aggregation and scan-heavy queries.