Duckdb

DuckDB هو نظام إدارة قواعد بيانات SQL تحليلي مضمن داخل العملية (in-process) ونظام OLAP. يعمل كمحرك بيانات لملفات Parquet و CSV، مما يسمح للمستخدمين بتنفيذ استعلامات SQL معقدة على مجموعات بيانات كبيرة دون الحاجة إلى عملية خادم منفصلة.

تم تصميم النظام للمعالجة التحليلية المحلية وسير عمل علوم البيانات المضمنة. وهو يتيح الاستعلام المباشر وتحليل ملفات Parquet و CSV من القرص، متجاوزاً الحاجة إلى تحميل البيانات في قاعدة بيانات دائمة.

يوفر المحرك تنفيذ SQL تحليلي عالي الأداء، بما في ذلك دعم وظائف النافذة والاستعلامات الفرعية المتداخلة. وهو يدمج تخطيط تخزين عمودي وتنفيذ استعلام متجه للتعامل مع معالجة البيانات واستكشافها على نطاق واسع.

يمكن الوصول إلى قاعدة البيانات عبر واجهة سطر أوامر مستقلة وارتباطات خاصة بلغات Python و R و Java و Wasm.

Features

In-Process Analytics - Runs the analytical database engine directly within the host application process to eliminate network latency.
Analytical Workload Engines - Optimized for heavy local analytical processing and OLAP workloads via an embedded engine.
Columnar Databases - Implements a storage engine optimized for analytical queries using columnar data structures.
Embedded Databases - Implements a relational storage engine that runs within the application process without a separate server.
File-Based Data Engines - Serves as a data engine that imports and queries large Parquet and CSV files directly using SQL.
File-Based Data Import - Enables direct loading and querying of CSV and Parquet files by referencing them within SQL queries.
Parquet Scanners - Optimizes Parquet integration by mapping file structures directly to internal formats for fast scanning and predicate pushdown.
Parquet Data Processing - Enables direct querying and analysis of Parquet and CSV files from disk without requiring a separate load step.
SQL Query Execution Engines - Provides a high-performance SQL execution engine supporting advanced window functions and nested subqueries.
Vectorized Execution Engines - Employs a vectorized execution engine that processes batches of data to maximize CPU cache efficiency.
Embedded Data Science Workflows - Integrates SQL database capabilities directly into Python, R, and Java environments for fast data exploration.
Morsel-Driven Parallelism - Utilizes morsel-driven parallelism to distribute data chunks across CPU cores for high concurrency.
Large Dataset Optimizations - Optimizes the processing of massive structured datasets using high-performance SQL queries and window functions.
Push-Based Query Pipelines - Implements a push-based execution pipeline to improve CPU cache locality and reduce function call overhead.
إدارة البيانات - Embeddable SQL database management system for analytics.

سجل النجوم

cwidaduckdb

Name: cwida/duckdb
Author: cwida

View on GitHub

38,822 نجوم3,328 تفرعاتC++MIT11 مشاهداتwww.duckdb.org

Duckdb

يمكن الوصول إلى قاعدة البيانات عبر واجهة سطر أوامر مستقلة وارتباطات خاصة بلغات Python و R و Java و Wasm.

Features

In-Process Analytics - Runs the analytical database engine directly within the host application process to eliminate network latency.
Analytical Workload Engines - Optimized for heavy local analytical processing and OLAP workloads via an embedded engine.
Columnar Databases - Implements a storage engine optimized for analytical queries using columnar data structures.
Embedded Databases - Implements a relational storage engine that runs within the application process without a separate server.
File-Based Data Engines - Serves as a data engine that imports and queries large Parquet and CSV files directly using SQL.
File-Based Data Import - Enables direct loading and querying of CSV and Parquet files by referencing them within SQL queries.
Parquet Scanners - Optimizes Parquet integration by mapping file structures directly to internal formats for fast scanning and predicate pushdown.
Parquet Data Processing - Enables direct querying and analysis of Parquet and CSV files from disk without requiring a separate load step.
SQL Query Execution Engines - Provides a high-performance SQL execution engine supporting advanced window functions and nested subqueries.
Vectorized Execution Engines - Employs a vectorized execution engine that processes batches of data to maximize CPU cache efficiency.
Embedded Data Science Workflows - Integrates SQL database capabilities directly into Python, R, and Java environments for fast data exploration.
Morsel-Driven Parallelism - Utilizes morsel-driven parallelism to distribute data chunks across CPU cores for high concurrency.
Large Dataset Optimizations - Optimizes the processing of massive structured datasets using high-performance SQL queries and window functions.
Push-Based Query Pipelines - Implements a push-based execution pipeline to improve CPU cache locality and reduce function call overhead.
إدارة البيانات - Embeddable SQL database management system for analytics.

بدائل مفتوحة المصدر لـ Duckdb

مشاريع مفتوحة المصدر مشابهة، مرتبة حسب عدد الميزات المشتركة مع Duckdb.

facebookincubator/velox
facebookincubator/velox
4,155عرض على GitHub
Velox is a high-performance C++ query execution engine and columnar data processing library. It serves as a composable framework for implementing analytical query engines, providing a vectorized expression evaluator and a toolkit for data management systems. The project is distinguished by its use of vectorized columnar execution and arena-based memory allocation to process large-scale datasets. It features specialized optimizations such as broadcast join table caching, dynamic filter push-down, and dictionary encoding to reduce memory overhead and accelerate analytical reads. The engine cov
C++
عرض على GitHub4,155
duckdb/duckdb
duckdb/duckdb
38,805عرض على GitHub
DuckDB is an in-process analytical database engine designed to run directly within an application process. As a zero-dependency, embedded system, it provides enterprise-grade SQL data processing capabilities without the overhead of managing a dedicated database server. It is built to handle complex analytical and aggregation tasks by storing and retrieving information in columns, allowing for high-performance relational data manipulation. The engine distinguishes itself through a columnar vectorized execution model that maximizes CPU cache efficiency during query operations. It employs adapti
C++analyticsdatabaseembedded-database
عرض على GitHub38,805
apache/hive
apache/hive
6,012عرض على GitHub
Apache Hive is a SQL-on-Hadoop data warehouse that enables querying and managing petabytes of data stored in distributed storage such as HDFS and cloud storage services. It provides a familiar SQL interface for batch analytics and reporting, supported by a core set of components including the HiveServer2 Thrift service for remote query execution, the Hive Metastore Service for central metadata management, the Hive ACID Transaction Engine for concurrent read-write operations, and the Hive LLAP Interactive Engine for low-latency analytical processing. The WebHCat REST API offers an HTTP interfac
Javaapachebig-datadatabase
عرض على GitHub6,012
lancedb/lancedb
lancedb/lancedb
9,031عرض على GitHub
LanceDB is a vector database and columnar data store designed to function as a versioned dataset manager and vector search engine. It serves as a high-performance backend for indexing and retrieving high-dimensional embeddings, providing the foundation for machine learning data pipelines. The system distinguishes itself through a combination of cloud-native object storage and immutable version tracking, allowing for data time-travel and reproducible AI experiments. It integrates hybrid search capabilities, merging dense vector similarity with BM25 full-text search and SQL-like scalar filters
HTMLapproximate-nearest-neighbor-searchimage-searchnearest-neighbor-search
عرض على GitHub9,031

عرض جميع البدائل الـ 30 لـ Duckdb

الأسئلة الشائعة

ما هي وظيفة cwida/duckdb؟

ما هي الميزات الرئيسية لـ cwida/duckdb؟

الميزات الرئيسية لـ cwida/duckdb هي: In-Process Analytics, Analytical Workload Engines, Columnar Databases, Embedded Databases, File-Based Data Engines, File-Based Data Import, Parquet Scanners, Parquet Data Processing.

ما هي البدائل مفتوحة المصدر لـ cwida/duckdb؟

تشمل البدائل مفتوحة المصدر لـ cwida/duckdb: facebookincubator/velox — Velox is a high-performance C++ query execution engine and columnar data processing library. It serves as a composable… duckdb/duckdb — DuckDB is an in-process analytical database engine designed to run directly within an application process. As a… apache/hive — Apache Hive is a SQL-on-Hadoop data warehouse that enables querying and managing petabytes of data stored in… lancedb/lancedb — LanceDB is a vector database and columnar data store designed to function as a versioned dataset manager and vector… apache/arrow — Arrow is a cross-language development platform for in-memory data. It provides a standardized, language-independent… risingwavelabs/risingwave — RisingWave is a cloud-native streaming database and real-time analytics engine that uses standard SQL to process…