Awesome GitHub RepositoriesEmbedded SQL Query Engines

Apache DataFusion is an extensible, columnar SQL query engine that runs embedded within a host application without requiring a separate server process. It processes data in columnar batches using Apache Arrow for memory-efficient analytics, and can scale analytic workloads across multiple nodes for parallel execution. The engine supports both SQL and DataFrame queries through a modular, streaming architecture that allows custom operators, data sources, functions, and optimizer rules. The engine distinguishes itself through its modular extension framework, which enables building custom query e

Harlequin is a terminal-based SQL IDE that runs queries against DuckDB and SQLite databases, with a plug-in adapter system for connecting to additional database engines. It provides a full-screen text editor with syntax highlighting and fuzzy autocomplete for writing SQL, and displays query results in a scrollable table within the terminal. The application distinguishes itself through a tree-based data catalog that lets you browse database schemas, local files, and remote S3 objects, with the ability to insert or copy paths directly into the query editor. It supports custom key bindings throu

Perfetto is a platform for system-level performance tracing and analysis on Linux and Android. It combines a high-throughput trace recorder, a SQL-based query engine, and a browser-based visualizer into a single toolchain. The platform covers CPU scheduling and call-stack profiling, native and Java heap memory allocation tracking, GPU and graphics events, and system-wide counters such as CPU frequency and power consumption. The architecture decouples trace recording from offline analysis, using a compact protobuf format for event encoding and columnar storage for efficient SQL queries. The we

esProc este un framework ETL distribuit și un motor de calcul de date încorporat. Oferă un limbaj de date structurate pentru Java Virtual Machine, conceput pentru interogări relaționale, calcul complex de date și analiză de date structurate. Sistemul dispune de o interfață de interogare a datelor în limbaj natural care utilizează modele de limbaj mari pentru a traduce cererile în interogări executabile pe seturi de date structurate. Utilizează un limbaj de interogare specific domeniului, cu o sintaxă concisă pentru a stabili relații între tabele și a recupera informații. Platforma acoperă integrarea datelor din surse relaționale și NoSQL disparate și gestionează fluxurile de lucru ETL pentru a muta datele între fișiere și baze de date. Capabilitățile suplimentare includ generarea de rapoarte de date structurate, o interfață de grilă în timp real pentru vizualizarea execuției pas cu pas și capacitatea de a integra biblioteci externe partajate personalizate.

ChatLab is a self-hosted chat database and data pipeline designed to normalize, store, and analyze large-scale social conversation histories. It functions as an analytics platform that uses large language models to extract patterns and insights from messaging data imported from multiple platforms. The system distinguishes itself through an AI-powered analysis engine that utilizes vector-based history analysis and agent-based function calling to summarize conversation trends. It further identifies behavioral patterns by generating visual analytics, including heatmaps, word clouds, and activity