Awesome GitHub RepositoriesIn-Process Analytics

DuckDB هو نظام إدارة قواعد بيانات SQL تحليلي مضمن داخل العملية (in-process) ونظام OLAP. يعمل كمحرك بيانات لملفات Parquet و CSV، مما يسمح للمستخدمين بتنفيذ استعلامات SQL معقدة على مجموعات بيانات كبيرة دون الحاجة إلى عملية خادم منفصلة. تم تصميم النظام للمعالجة التحليلية المحلية وسير عمل علوم البيانات المضمنة. وهو يتيح الاستعلام المباشر وتحليل ملفات Parquet و CSV من القرص، متجاوزاً الحاجة إلى تحميل البيانات في قاعدة بيانات دائمة. يوفر المحرك تنفيذ SQL تحليلي عالي الأداء، بما في ذلك دعم وظائف النافذة والاستعلامات الفرعية المتداخلة. وهو يدمج تخطيط تخزين عمودي وتنفيذ استعلام متجه للتعامل مع معالجة البيانات واستكشافها على نطاق واسع. يمكن الوصول إلى قاعدة البيانات عبر واجهة سطر أوامر مستقلة وارتباطات خاصة بلغات Python و R و Java و Wasm.

DuckDB is an in-process analytical database engine designed to run directly within an application process. As a zero-dependency, embedded system, it provides enterprise-grade SQL data processing capabilities without the overhead of managing a dedicated database server. It is built to handle complex analytical and aggregation tasks by storing and retrieving information in columns, allowing for high-performance relational data manipulation. The engine distinguishes itself through a columnar vectorized execution model that maximizes CPU cache efficiency during query operations. It employs adapti

Marimo is a reactive Python notebook environment and data science integrated development environment. It functions as a scripting tool that maintains state consistency by automatically tracking variable dependencies and re-executing downstream code blocks whenever upstream inputs are modified. The platform distinguishes itself by storing notebooks as standard, portable Python scripts rather than proprietary formats, ensuring compatibility with version control systems. It integrates artificial intelligence to assist with code generation and debugging based on the current execution context, whi

Arrow is a cross-language development platform for in-memory data. It provides a standardized, language-independent columnar memory format designed to accelerate analytical operations and improve memory efficiency on modern computing hardware. By utilizing a schema-driven approach, the framework enables the efficient organization of both flat and nested data structures. The project functions as an analytical data processing engine that facilitates high-performance computation directly on memory-resident datasets. It distinguishes itself through a zero-copy architecture, which allows multiple

Enso is a visual dataflow programming environment and multi-language data processing engine that compiles Enso, Python, Java, and JavaScript into a unified representation with a shared memory model for zero-overhead inter-language calls. It functions as a self-service data preparation and analysis platform where users can build data pipelines by connecting nodes in a graph, switching between a no-code visual interface and a code view while keeping all changes reviewable. The platform also serves as a cloud data workflow scheduler and API exposer, allowing workflows to run on a timetable or be