14 repositorios
Analytical processing of large datasets using complex aggregations and vectorized execution for high-speed response.
Distinct from Multi-Dataset Analysis: The candidates provided were either for 3D visualization or scientific arrays; this is about OLAP-style multi-dimensional SQL analysis.
Explore 14 awesome GitHub repositories matching data & databases · Multi-Dimensional Analysis. Refine with filters or upvote what's useful.
StarRocks is a distributed SQL OLAP database engine designed for real-time analytics and high-performance multi-dimensional analysis. It functions as a data lakehouse query engine that enables SQL execution across large datasets and external open table formats without requiring local data imports. The system employs a shared-nothing distributed architecture and utilizes the MySQL protocol to integrate with business intelligence tools. It maintains real-time data consistency through a primary key upsert model and accelerates query response times using vectorized execution and cost-based optimi
Performs complex aggregations and ad-hoc queries across large datasets using vectorized processing.
Boost is a collection of portable, high-performance source libraries that extend the C++ standard library. It provides a wide range of reusable components, data structures, and algorithms designed to add capabilities to the base language across different platforms. The project is distinguished by its extensive focus on compile-time template metaprogramming and generic programming. It implements advanced architectural patterns such as policy-based design, concept-based type validation, and the use of SFINAE for conditional template resolution to minimize runtime overhead. The library covers a
Analyzes complex data distributions across multiple axes using multi-dimensional histograms.
dc.js is a multi-dimensional analysis tool and visualization framework used to build interactive data dashboards. It functions as a charting library that renders diverse SVG visualizations powered by D3 and integrates natively with Crossfilter to enable coordinated filtering across large datasets. The project is distinguished by its linked-view coordination, where selecting a data range or category in one chart simultaneously updates all other connected views. This allows for dynamic data exploration through dimensional chart linking and coordinated brushing, transforming raw datasets into na
Connects SVG or Canvas visualizations to multi-dimensional data stores for coordinated filtering and analysis.
GrowthBook is a feature flagging and experimentation platform that utilizes a warehouse-native approach to data analysis. It serves as a system for managing feature rollouts and conducting A/B tests by executing SQL queries directly against existing data warehouses to calculate experiment results. The platform is distinguished by its integration of a Model Context Protocol server, which allows AI coding assistants and IDEs to manage flags and query analytics using natural language. It also provides specialized capabilities for AI model optimization, enabling the testing of prompts and models
Breaks down experiment performance across user attributes like geography or platform using multi-dimensional analysis.
Pinot is a distributed, columnar analytical database designed for high-concurrency, low-latency query processing. It functions as a real-time OLAP datastore, enabling interactive, user-facing analytics by ingesting and querying massive datasets from both streaming and batch sources. The system architecture relies on a centralized controller for cluster coordination and a distributed segment-based storage model to ensure horizontal scalability. The platform distinguishes itself through a hybrid ingestion pipeline that unifies real-time event streams and historical batch data into a single quer
Performs multi-dimensional analysis including slice, dice, and drill-down operations on large datasets.
Prometheus client_golang is the official Go client library for instrumenting applications with Prometheus metrics. It provides a metric registry that manages and exposes custom application metrics like counters, gauges, histograms, and summaries in Prometheus format for HTTP scraping by a Prometheus server. The library also includes a remote read client that sends PromQL queries to a Prometheus server over HTTP and retrieves time series data programmatically. The library supports creating separate registries to isolate metric namespaces and control which metrics are exposed per scrape endpoin
Enables multi-dimensional time series through dynamic label-value pairs on metric families.
Este proyecto es una librería de machine learning que proporciona una colección de implementaciones para algoritmos de aprendizaje supervisado y no supervisado. Sirve como un framework de deep learning, una colección de clasificadores estadísticos y una suite de herramientas para aprendizaje no supervisado y reducción de dimensionalidad. La librería permite la construcción de redes neuronales, incluyendo perceptrones multicapa y redes convolucionales para el reconocimiento de patrones. También proporciona herramientas para realizar análisis de componentes principales y aprendizaje de variedades (manifold learning) para visualizar datasets de alta dimensión, junto con una suite de algoritmos de clustering que agrupan datos no etiquetados mediante particionamiento iterativo. El proyecto cubre una amplia gama de capacidades de modelado predictivo, incluyendo tareas de clasificación y regresión usando árboles de decisión, k-vecinos más cercanos, clasificadores de Bayes, máquinas de vectores de soporte y regresión ridge. También incluye herramientas para flujos de trabajo de clasificación de imágenes y el análisis de datos no etiquetados.
Implements manifold learning to visualize complex, high-dimensional datasets in lower dimensions.
Lucid es un toolkit de interpretabilidad y librería de visualización para TensorFlow diseñado para analizar las representaciones internas de redes neuronales. Funciona como un framework de optimización basado en gradientes que genera imágenes y atlas para revelar las características aprendidas por neuronas y capas específicas. La librería permite la creación de atlas de activación y el mapeo de activaciones neuronales de alta dimensión en espacios de menor dimensión para estudiar el comportamiento del modelo. Utiliza parametrización de imágenes diferenciable para optimizar entradas visuales que activen al máximo los componentes de la red. El sistema cubre una amplia gama de infraestructura de interpretabilidad, incluyendo el mapeo de distribución de activaciones y la investigación de visualización de características. También incluye utilidades para importar modelos pre-entrenados y persistir pesos de red para análisis continuos.
Maps high-dimensional activations into lower-dimensional spaces to visualize the distribution of internal representations.
Yellowbrick es una librería de visualización de machine learning y herramienta de diagnóstico de modelos diseñada para analizar la importancia de las características, distribuciones objetivo y métricas de error del modelo. Sirve como un kit de herramientas visual para diagnosticar el subajuste (underfitting) y sobreajuste (overfitting) mediante el uso de curvas de validación y aprendizaje. El proyecto proporciona suites especializadas para evaluar modelos predictivos y aprendizaje no supervisado. Permite la determinación de conteos de clústeres óptimos mediante métodos de codo y coeficientes de silueta, y evalúa la calidad de clasificadores y regresores a través de curvas ROC, matrices de confusión y gráficos de residuos. La librería cubre varias áreas de capacidad de alto nivel, incluyendo análisis de ingeniería de características para identificar variables predictivas, ajuste de hiperparámetros para ajustar la complejidad del modelo y diagnóstico de errores de regresión para identificar puntos de datos influyentes. También incluye herramientas para proyección de aprendizaje de variedades (manifold learning) para visualizar datos de alta dimensión y corpus de texto. La herramienta se integra con la API de Scikit-Learn para consumir métodos estándar de fit y predict.
Implements non-linear dimensionality reduction like t-SNE and UMAP to visualize high-dimensional data in 2D or 3D.
This is a Prometheus Python client library used for instrumenting Python applications. It provides the tools necessary to record counters, gauges, and histograms within a process to monitor application health and expose that data as a Prometheus exposition format provider. The library enables cloud native observability by allowing developers to define custom telemetry and track internal application events. It transforms internal application data into a standardized text format required by Prometheus scrapers for collection. The project covers a variety of monitoring and observability capabil
Supports multi-dimensional time series by organizing metrics using label-value pairs for flexible filtering.
Stumpy es una librería de Python para análisis de series temporales escalable centrada en la implementación de algoritmos de perfil de matriz (matrix profile). Proporciona un framework para calcular perfiles de distancia para identificar patrones repetitivos y anomalías dentro de datos de series temporales. El proyecto se distingue por su capacidad para escalar cálculos pesados a través de hardware GPU y clusters distribuidos utilizando Dask. Admite análisis multidimensional para descubrir motivos a través de flujos de datos concurrentes y ofrece computación incremental para análisis de streaming en tiempo real. La librería cubre una amplia gama de técnicas de minería de series temporales, incluyendo descubrimiento de motivos, detección de anomalías y coincidencia de patrones de secuencia. También proporciona herramientas para segmentación semántica para detectar cambios de régimen y la extracción de cadenas ordenadas temporalmente de patrones de subsecuencia similares.
Computes dimensionality and bit-size for compressing multi-dimensional subsequences using minimum description length.
pytorch-fid is a PyTorch-based evaluator and image distribution analysis library used to calculate the Fréchet Inception Distance. It functions as a benchmarking tool that maps image pixels to high-dimensional feature vectors using a pre-trained convolutional neural network to measure the mathematical divergence between real and synthetic datasets. The library quantifies the quality and diversity of generative models by representing image feature sets as mean and covariance matrices. It allows for the extraction of latent representations from specific neural network layers, with configurable
Analyzes high-dimensional probability distributions of image features to measure the mathematical divergence between datasets.
Kylin is a distributed OLAP engine designed for executing fast SQL queries on massive datasets. It utilizes multi-dimensional data cubes to pre-calculate data aggregates, enabling sub-second response times for large-scale analytical queries and big data analytics. The system focuses on large-scale data warehousing and multi-dimensional data modeling. It allows for the organization and querying of vast amounts of structured data to support business intelligence and reporting workflows through distributed SQL querying.
Executes complex analytical queries on large datasets using a distributed engine for high-speed responses.
POT is an optimal transport library providing a collection of solvers for computing Wasserstein, Gromov-Wasserstein, and Fused Gromov-Wasserstein distances between probability distributions. It functions as a differentiable tensor framework that integrates with various tensor libraries to enable automatic differentiation and GPU acceleration. The project is distinguished by its ability to align data distributions across different metric spaces by comparing internal relational structures rather than coordinates. It implements mathematical optimization algorithms as differentiable layers, allow
Analyzes complex high-dimensional probability distributions using slicing and projection techniques to reduce complexity.