8 Repos
Tools for creating and organizing data queries.
Distinguishing note: Focuses on query lifecycle management rather than database storage.
Explore 8 awesome GitHub repositories matching data & databases · Data Query Management. Refine with filters or upvote what's useful.
ToolJet is a low-code development platform designed for building and deploying internal business applications. It provides a visual interface where users can drag and drop components to design layouts, connect to various data sources, and execute custom logic. The platform is built on a containerized architecture, ensuring that applications remain portable and consistent across different cloud and server environments. The platform distinguishes itself through integrated artificial intelligence capabilities that assist in the generation of user interfaces, database schemas, and data queries fr
Builds new data queries by selecting from available sources within a dedicated interface.
dbt-core is a command-line framework for transforming data within a warehouse using modular SQL and version control. It functions as a data transformation engine that enables users to define data structures and business logic through declarative configuration files, which the system then compiles into executable code. By managing complex data dependencies through a directed acyclic graph, it ensures that transformation tasks execute in the correct order while maintaining a manifest-driven state to track lineage and execution history. The project distinguishes itself through an adapter-based d
Stores and retrieves frequently used query definitions to ensure consistent reporting across teams.
Citus is a PostgreSQL extension that transforms a standard database into a distributed system. It functions as a sharding framework and distributed SQL engine, enabling horizontal scaling by partitioning tables across a cluster of nodes. By utilizing a coordinator-worker topology, the system manages metadata and routes queries to the appropriate nodes, allowing for parallel execution of complex operations across distributed data shards. The platform distinguishes itself through its specialized support for multi-tenant architectures and real-time analytical processing. It enables tenant-based
Creates pre-aggregated tables at defined time intervals to speed up analytical queries and reduce storage requirements.
Rerun is a multimodal data visualizer and robotics data logger designed for rendering synchronized streams of 3D spatial data, images, and time-series metrics. It functions as a tool for capturing high-frequency sensor data and AI outputs into a queryable columnar format, providing a dedicated interface for viewing MCAP recording files and analyzing physical environments. The project distinguishes itself as a machine learning dataset streamer, capable of feeding logged recordings directly into GPU buffers and PyTorch training pipelines without intermediate exports. It supports a high-performa
Includes tools for retrieving and transforming multimodal data from a catalog for local analysis and team management.
This project is a Go client library and API wrapper for interacting with Elasticsearch clusters. It serves as a programmatic interface for managing documents, indices, and cluster health, allowing Go applications to perform search and indexing operations via the REST API. The library functions as a distributed search orchestrator, providing specialized tools for high-throughput data ingestion and cluster administration. It features a buffered bulk processor with exponential backoff retries for optimizing write performance and supports automated index lifecycle transitions and historical data
Summarizes historical data into compact forms by creating and controlling rollup jobs.
Dieses Projekt ist ein Software Development Kit (SDK) und Cluster-Management-Tool für PHP. Es dient als SDK für Volltextsuche und Vektor-Suchschnittstelle, wodurch Anwendungen lexikalische, Fuzzy- und semantische Suchen auf indizierten Daten durchführen können. Die Bibliothek implementiert einen PSR-7-HTTP-Client, um die Kompatibilität zwischen verschiedenen Umgebungen durch standardisierte Messaging-Schnittstellen zu gewährleisten. Sie bietet eine spezialisierte Schnittstelle zum Abrufen von Embeddings und zur Durchführung semantischer Retrieval-Workflows unter Verwendung von Vektordaten. Der Funktionsumfang deckt eine breite Palette administrativer und operativer Aufgaben ab, einschließlich der Verwaltung von Suchindizes, der Überwachung des Cluster-Status und der Verwaltung von Dokumentlebenszyklen. Es unterstützt diverse Abfragemethoden wie SQL, EQL und ES|QL sowie Datenaggregation und Geodatenanalyse. Zusätzlich bietet es Tools für Machine-Learning-Orchestrierung, Anomalieerkennung sowie Identitäts- und Zugriffsmanagement.
Manages automated rollup jobs to summarize historical data into searchable indices for accelerated analytical queries.
TablePro is a cross-platform database management client designed for browsing, querying, and administering both SQL and NoSQL databases. It functions as a unified workspace that integrates a code-centric SQL editor with schema visualization tools, allowing developers to manage complex data models and execute queries across diverse database engines. The application distinguishes itself through an agentic AI integration layer that connects language models directly to database tools, enabling automated query generation, optimization, and error fixing with configurable approval gates. It features
Executes GoogleSQL queries and provides a data grid for browsing, editing, and deleting rows across datasets and tables.
Ahoy ist ein First-Party-Analytics-Framework für Ruby-on-Rails-Anwendungen. Es bietet Tools zur Erfassung von Benutzerverhalten und Seitenaufrufen, wodurch Entwickler die volle Kontrolle über ihre Analysedaten behalten. Das System zeichnet sich durch relationale Datenanalyse aus, die Besuchsidentifikatoren direkt mit Anwendungsmodellen für eine tiefgehende Zuordnung von Geschäftsobjekten verknüpft. Es enthält ein datenschutzfreundliches Tracking-Tool, das IP-Adressmaskierung und Cookie-loses Gruppieren von Besuchern nutzt, um Benutzerdaten zu anonymisieren. Das Projekt deckt ein breites Spektrum an Analysefunktionen ab, einschließlich benutzerdefiniertem Event-Tracking, geografischer Standortauflösung via IP-Geocoding und User-Funnel-Analyse. Es verwaltet Daten durch relationale Datenbankpersistenz und nutzt voraggregierte Rollups, um die Abfrage-Performance bei großen Datensätzen zu wahren. Zusätzliche Infrastrukturfunktionen umfassen asynchrones Message-Routing, Middleware-Level-Traffic-Filterung zum Ausschluss von Bots und eine dedizierte API zum Sammeln von Daten von mobilen oder externen Clients.
Summarizes high-volume event data into periodic totals to maintain fast query performance on large datasets.