25 Repos
Components for processing and executing dynamic database queries with parameter support.
Distinguishing note: None of the candidates were provided; this focuses on the execution logic for parameterized queries.
Explore 25 awesome GitHub repositories matching data & databases · Query Execution Engines. Refine with filters or upvote what's useful.
ClickHouse is a high-performance, columnar analytical database designed for real-time query execution and large-scale data aggregation. It functions as a distributed data warehouse capable of processing petabytes of information, while also providing an embedded engine that integrates directly into applications for native query capabilities without external dependencies. The system is built to handle high-throughput ingestion and complex analytical workloads, delivering millisecond-level latency for interactive dashboards and operational monitoring. The platform distinguishes itself through ad
Processes blocks of data using SIMD instructions to maximize CPU efficiency during complex analytical calculations and aggregations.
Polars is a high-performance columnar data processing library designed for efficient analytical workflows. It functions as a structured data library that organizes information into typed columns, utilizing the Apache Arrow memory format to enable zero-copy data sharing and cache-friendly, vectorized operations. The engine is built to handle large-scale tabular datasets, providing both local and distributed analytical runtimes that scale from single-machine environments to multi-node clusters. The project distinguishes itself through a sophisticated lazy query engine that constructs abstract e
Generates and executes efficient plans that distribute workloads across all available processor cores.
RethinkDB is a distributed, document-oriented database designed to store and manage JSON-formatted data across scalable clusters. It utilizes a custom log-structured storage engine with B-Tree indexing to ensure high-performance disk I/O and data persistence. The system maintains high availability through automatic sharding and replication, employing a primary-replica voting consensus mechanism to handle node failures and ensure consistent cluster operations. A defining characteristic of the platform is its reactive changefeed engine, which allows applications to subscribe to live data update
"Transforms fluent query chains into parallelized execution plans that stream data chunks from multiple servers to the client for efficient processing."
Letta is a framework for building, deploying, and managing autonomous AI agents that maintain persistent state across long-term interactions. It provides a comprehensive suite of primitives for defining agents with configurable personas, modular memory blocks, and tool-use capabilities, enabling them to retain user preferences and conversation history over extended sessions. The platform distinguishes itself through its advanced memory management and orchestration capabilities. It allows agents to autonomously update their own memory, perform retrieval-augmented generation, and coordinate com
Processes single prompts and returns responses without requiring the overhead of maintaining long-term sessions.
DB-GPT is an agentic data analysis platform and business intelligence AI that functions as a large language model data assistant. It provides a text-to-SQL interface and a sandboxed code execution environment to translate natural language into executable database queries and Python scripts. The platform utilizes iterative agentic reasoning to plan and execute multi-step data analysis workflows through tool calls. It features a modular skill-based extension system that allows domain knowledge and analysis workflows to be packaged into reusable functional components. The system integrates data
Transforms natural language instructions into executable Python scripts and SQL queries for dataset analysis.
Gel is an object-relational database system that models data as a graph of interconnected objects. By utilizing a strongly typed schema, it enables complex relational queries and polymorphic data structures without the need for traditional join tables. The system integrates native vector storage and similarity search operators, allowing it to function as both a relational and a vector database for semantic data retrieval. The platform distinguishes itself through a comprehensive suite of developer-centric automation tools. It features a declarative migration system that tracks and versions sc
Supports connecting applications to the database using language-specific drivers or standard HTTP requests for custom code and automated workflows.
OpenBrowser is an AI web agent toolkit and automation framework designed to translate natural language instructions into executable browser workflows. It functions as a headless browser controller and orchestrator, enabling the creation of autonomous agents that navigate websites, interact with elements, and extract data using plain English commands. The system features a sandboxed execution environment that utilizes domain whitelists and memory limits to ensure secure web interaction. It distinguishes itself through a command-line interface for triggering autonomous tasks with configurable m
Enables triggering autonomous tasks and specifying model providers via a command-line interface.
LiteDB is a serverless, embedded NoSQL document database for .NET applications. It persists data into a single portable file, functioning as a BSON data store that resides within the application process rather than running as a separate server. The system is ACID compliant, utilizing write-ahead logging to ensure atomic, consistent, isolated, and durable transactions. It includes built-in encryption to provide secure local data storage and protect files on disk from unauthorized access. The project covers object-document mapping to convert classes into document formats, indexed search capabi
Implements a high-performance query execution engine for indexed searches and data retrieval.
AI Town is a TypeScript-based simulation engine used to create virtual environments where autonomous characters interact and socialize. It functions as a framework for orchestrating multiple AI agents within a persistent digital world, utilizing language models and a game engine to drive character behavior and social interactions. The project differentiates itself through a dedicated agent sandbox and a vector database agent store, which allow for the management of agent memories and world state. It integrates generative AI for background music and provides tools for simulation world design,
Supports reading the current database state in response to specific user actions.
Oatpp is a high-performance C++ web framework and API development kit used for building REST APIs and web services. It functions as an asynchronous HTTP server that utilizes coroutines to handle thousands of simultaneous connections without blocking threads. The toolkit includes a native C++ object-relational mapping layer for executing SQL queries and transforming database results into data objects. It also provides a WebSocket communication library for establishing full-duplex channels to support real-time data streaming and live media. The framework covers a broad range of capabilities, i
Includes an engine for processing and executing dynamic database queries with runtime parameter support.
DevOps-Bash-tools is a collection of shell scripts and aliases designed to automate cloud infrastructure, container orchestration, and CI/CD pipelines. It provides a comprehensive toolset for managing operational workflows through the command line. The project specializes in automating tasks across multiple platforms, including managing namespaces and secrets in Kubernetes, auditing resources in AWS and GCP, and triggering builds or managing environment variables in GitHub Actions, GitLab CI, and CircleCI. It also includes a toolkit for interacting with container registries to query manifests
Iterate queries over all tables using environment variables for connection.
Forgecode is an AI agent orchestrator, shell integration tool, and terminal-based pair programmer. It enables the deployment of specialized AI roles for research, planning, and implementation, while providing a semantic code search tool to index project files for meaning-based retrieval. The system integrates as a Model Context Protocol client to extend AI capabilities via external servers and supports multi-provider model orchestration to switch between different large language model APIs. It transforms natural language into functional shell commands and allows for the execution of AI prompt
Allows running a single AI request from the shell and exiting immediately for use in scripts or pipes.
This project is a Rust-based AI agent framework and tool orchestrator that provides a command-line interface for interacting with large language models. It functions as an AI tool orchestrator that routes client requests to language servers and manages the planning and handoffs between specialized agents to solve complex tasks. The system distinguishes itself as a language porting validator, using deterministic mocks and specifications to verify feature parity between different language implementations of a codebase. It further extends agent capabilities by acting as a Model Context Protocol
Enables executing single AI requests from the shell without initiating a stateful interactive session.
Ibis is a portable Python dataframe library and multi-backend query engine that provides a unified interface for executing data transformations across diverse compute engines. It functions as a Python SQL expression compiler and dialect transpiler, allowing users to define data logic once and execute it across cloud warehouses, embedded databases, and distributed clusters without rewriting code. The project distinguishes itself through a database backend abstraction that decouples transformation logic from the underlying execution engine. It enables polyglot data workflows by mixing raw SQL s
Executes data transformations across different SQL databases and cloud warehouses using a single unified Python interface.
Kimi is a terminal-based AI agent that autonomously plans and executes software development tasks by reading, editing, and running code. It operates as an intelligent command-line agent that breaks down high-level goals into sequences of shell commands and code edits, carrying them out without manual step-by-step guidance. The agent can run in an interactive loop, switch to a shell mode for direct terminal command execution, and operate in non-interactive or one-shot modes suitable for scripting. The project distinguishes itself through multiple integration and execution modes. It can run as
Ships a one-shot mode that feeds a single prompt and exits, suitable for scripting.
TaskWeaver is an LLM agent framework that interprets natural language requests and executes them as Python code, SQL queries, or shell commands. It functions as a conversational code interpreter that maintains stateful data structures across turns, generating executable code from user prompts within a session-based environment. The system is designed as a self-hosted AI agent platform that can be deployed in Docker, managing sessions and providing a web UI for data analytics and automation tasks. The framework distinguishes itself through a role-based multi-agent architecture that divides the
Using natural language to generate and execute Python code for data manipulation, analysis, and visualization tasks.
Apache Hive is a SQL-on-Hadoop data warehouse that enables querying and managing petabytes of data stored in distributed storage such as HDFS and cloud storage services. It provides a familiar SQL interface for batch analytics and reporting, supported by a core set of components including the HiveServer2 Thrift service for remote query execution, the Hive Metastore Service for central metadata management, the Hive ACID Transaction Engine for concurrent read-write operations, and the Hive LLAP Interactive Engine for low-latency analytical processing. The WebHCat REST API offers an HTTP interfac
Executes queries on Spark, Tez, or MapReduce to balance performance and resource usage.
Lux ist ein automatisiertes Tool zur explorativen Datenanalyse, das entwickelt wurde, um intelligente visuelle Darstellungen von pandas Dataframes zu generieren. Es identifiziert Muster und Trends, indem es optimale Diagrammtypen und Achsen-Mappings basierend auf den statistischen Attributen eines Datensatzes empfiehlt. Das Tool fungiert als interaktive Datenprofilierungsschicht, die es Benutzern ermöglicht, Sammlungen von Diagrammen mithilfe von Filtern und Platzhaltern zu durchsuchen und abzufragen. Es dient zudem als Visualisierungs-Code-Generator, der automatisch erstellte Diagramme in programmatischen Code oder HTML zur manuellen Verfeinerung in externen Bibliotheken übersetzt. Das System deckt ein breites Spektrum an explorativen Analysefunktionen ab, einschließlich automatisierter Diagramm-Kodierung, geführter Entdeckung durch Schritt-Empfehlungen und der Möglichkeit, visuelle Konfigurationen als deklarative Spezifikationen zu exportieren. Dieses Projekt integriert sich direkt in pandas, um das Standard-Dataframe-Drucken durch interaktive Visualisierungskomponenten zu überschreiben.
Translates automatically produced charts into programmatic code or HTML for manual refinement in external libraries.
Dieses Projekt ist ein KI-gestütztes Tool für statische Analyse und ein automatisierter Schwachstellenscanner, der darauf ausgelegt ist, Sicherheitslücken wie Injektionen und Authentifizierungsumgehungen zu erkennen. Es verwendet große Sprachmodelle, um semantische Schlussfolgerungen über mehrere Programmiersprachen hinweg durchzuführen und Schwachstellen innerhalb von Codeänderungen zu identifizieren. Das Tool arbeitet als GitHub Action, die in CI-Pipelines integriert wird, um Pull-Request-Diffs zu analysieren. Es konzentriert sich auf modifizierte Codezeilen, um neue Risiken gezielt anzugehen, und meldet Ergebnisse durch das Posten automatisierter Kommentare direkt im Pull Request. Die Analyse wird durch anpassbare Sicherheitsrichtlinien und externe Regelinjektion gesteuert, was projektspezifische Anweisungen ermöglicht. Diese benutzerdefinierten Regeln und Filter werden verwendet, um Rauschen zu reduzieren und Ergebnisse mit geringer Auswirkung zu verwerfen, um Sicherheitsrisiken mit hoher Konfidenz zu priorisieren.
Processes code snippets through structured prompts to generate security assessments without a persistent database.
This project is a comprehensive collection of Python programming education materials, including tutorials, exercises, and curated code samples. It serves as a learning curriculum and software engineering toolkit, utilizing Jupyter Notebooks to combine executable code with descriptive educational text. The repository provides practical implementation guides for building large language model applications, such as retrieval-augmented generation systems, stateful AI agents, and machine learning workflows. It distinguishes itself by offering a structured approach to agentic coding workflows, cover
Allows executing single AI requests from the shell via command-line flags without maintaining session state.