30 个仓库
Tools for graphically analyzing and exploring massive datasets through interactive visualizations.
Distinct from Visual Data Explorers: Focuses specifically on the visual exploration aspect of big data processing, rather than just the computational processing engine.
Explore 30 awesome GitHub repositories matching data & databases · Visual Data Explorers. Refine with filters or upvote what's useful.
Nebula is a distributed graph database designed for storing and querying massive volumes of interconnected vertices and edges across a horizontally scalable cluster. It functions as a Kubernetes-native database and a distributed graph analytics engine, utilizing a Raft-based distributed store to ensure strong consistency and high availability. The system features an OpenCypher query engine for performing complex graph traversals and pattern matching. It distinguishes itself with a decoupled compute-storage architecture and a shared-nothing distributed design, allowing query processing and dat
Ships a web-based explorer for composing schemas, importing data, and visually exploring graph relationships.
FiftyOne 是一个用于策划、分析和管理机器学习模型训练所需的图像和视频数据集的视觉工具。它作为一个平台,用于识别标注错误、优化真值标签,并通过将预测结果与真值进行比较来评估视觉模型性能,从而识别故障模式。 该系统作为一个容器化数据平台,支持团队在云环境中对大规模视觉数据集进行协作。它包括用于探索高维嵌入以发现数据聚类并检索相应视觉样本的专门功能。 该平台涵盖了广泛的功能,包括 2D 和 3D 数据标注、数据集质量验证和视觉数据探索。它与深度学习框架集成,将数据从策划阶段转移到模型训练阶段,并利用基于文档的元数据存储来管理数据集结构。
Provides an interactive visual interface for browsing and analyzing large-scale image and video datasets.
Vaex is a high-performance Apache Arrow DataFrame library and out-of-core data processing engine designed to handle billion-row tabular datasets in Python. It functions as a lazy evaluation framework that defers computations and transformations until results are required, enabling the processing of datasets that exceed available system RAM by mapping files directly from disk. The project distinguishes itself as a tool for big data visualization and exploration, specifically integrated for use within interactive notebooks. It provides specialized capabilities for machine learning feature engin
Provides a system for analyzing and visualizing billions of rows of tabular data within interactive notebooks.
A/B Street is an open-source traffic simulation and urban planning tool that models how cars, bikes, and pedestrians move through real-world street networks. It imports data from OpenStreetMap to build detailed, lane-level road models, then runs discrete-event simulations to analyze travel times, delays, and congestion patterns across different infrastructure scenarios. The project provides an interactive map editor for modifying road geometry, lane configurations, traffic signals, and access restrictions, with full undo/redo support. Users can design low-traffic neighborhoods by placing moda
Displays per-agent routes, scatter plots of intersection delays, and sortable trip tables for aggregate analysis of simulation results.
vis is a JavaScript data visualization library used to render interactive networks, timelines, and graphs directly in the web browser. It functions as a relational data mapper and browser-based charting tool, turning complex structured data into dynamic visual patterns to expose entity relationships. The library provides specialized tools for force-directed network graphs, where relational data is represented as interactive nodes and edges. It also includes an interactive timeline component for plotting chronological events and time intervals on a scalable temporal axis. The project covers b
Enables graphical analysis and exploration of complex relational datasets through interactive network visualizations.
Facets is a set of interactive software tools for the statistical analysis, distribution visualization, and multidimensional exploration of machine learning datasets. It provides a visual interface for identifying outliers and missing values in numeric and string data, specifically designed for auditing dataset quality and identifying skews between training and validation sets. The system uses multidimensional facet-based visualization and interactive bucketing to map individual data points across multiple feature axes. It employs synchronized view filtering and animated dimension transitions
Enables mapping of individual data points across multiple dimensions using interactive bucketing for error detection.
GrowthBook is a feature flagging and experimentation platform that utilizes a warehouse-native approach to data analysis. It serves as a system for managing feature rollouts and conducting A/B tests by executing SQL queries directly against existing data warehouses to calculate experiment results. The platform is distinguished by its integration of a Model Context Protocol server, which allows AI coding assistants and IDEs to manage flags and query analytics using natural language. It also provides specialized capabilities for AI model optimization, enabling the testing of prompts and models
Transforms warehouse data into interactive charts and pivot tables for visual exploration of user behavior.
SandDance is a hardware-accelerated visualization library and web-based data explorer designed for the interactive analysis of large, non-aggregated datasets. It functions as an interactive data visualization tool that renders complex datasets and intricate visuals within a browser. The project provides an embeddable data canvas consisting of web components and tags, allowing for the integration of full visualization interfaces and interactive charts into external web applications. It utilizes WebGL hardware acceleration to efficiently render large volumes of data as interactive graphics. Th
Provides a web-based tool for graphically analyzing and exploring massive datasets through interactive visualizations.
Data-Juicer is an open-source framework for cleaning, filtering, deduplicating, and transforming multimodal datasets to prepare them for training large language and vision models. It functions as a distributed data pipeline engine that runs processing jobs across Ray clusters, handling billions of samples with automatic operator fusion and adaptive parallelism. The framework provides a library of operators that leverage large language models for semantic extraction, filtering, and data synthesis within processing pipelines. The project distinguishes itself through a YAML-based data recipe sys
Generates charts and plots to explore dataset properties, such as sample distributions and quality metrics.
Gephi is an open-source desktop application for visualizing and analyzing large-scale network graphs. It provides an interactive platform for exploring complex relational data, combining hardware-accelerated rendering with real-time layout controls and a plugin-based modular architecture. The platform distinguishes itself through its ability to handle networks of up to 100,000 nodes and 1,000,000 edges using a custom OpenGL rendering engine, enabling smooth real-time interaction. It includes a force-directed layout engine with real-time adjustment, a dynamic filter pipeline for selecting node
Ships an interactive visualization platform for exploring and analyzing large relational datasets.
Fast n-dimensional filtering and grouping of records.
Explores large multivariate datasets with coordinated filtering across dimensions and real-time visualization updates.
Aim is an open-source platform for logging, visualizing, and comparing machine learning training runs and LLM traces. It provides a remote tracking server and a comparison UI, functioning as an ML experiment tracker, AI workflow logger, and LLM trace recorder that captures prompts, generations, and tool calls from AI applications. The platform distinguishes itself through a run-based data model with local SQLite storage, real-time metric streaming, and a plugin-based explorer system that supports specialized visual analysis of metrics, images, audio, and text. It offers a Python SDK with cont
Uses specialized explorers to compare thousands of sessions of metrics, images, text, and audio.
本项目是一个机器学习教育课程和学习平台,通过交互式 Jupyter Notebooks 提供。它作为掌握 Python 数据科学工具包的综合指南,为数值计算、表格数据操作和统计可视化提供结构化教程。 该课程包括 Scikit-Learn 的具体实现指南,以及关于构建、训练和部署神经网络及计算机视觉模型的 TensorFlow 实践课程。它涵盖了构建预测模型的端到端过程,从初始问题定义和任务分类,到通过交互式 Web 界面部署模型。 该项目涵盖了广泛的功能领域,包括多维数组的数值计算、探索性数据分析和数据预处理例程。它为监督和无监督学习、自动化机器学习流水线、超参数优化以及使用分类指标和交叉验证的模型评估提供了详细的工作流。 教育内容组织为一系列 Notebook,将 Python 代码与叙述性解释交织在一起,以记录数据科学工作流。
Provides techniques for examining dataset composition and class balance to inform preprocessing decisions.
Orange3 is a visual data mining platform that provides an interactive canvas for building data analysis workflows without writing code. At its core, it offers a widget-based visual programming environment where users connect configurable components to perform data preprocessing, machine learning model training, statistical evaluation, and interactive visualization. The platform is built on NumPy-backed data tables with domain descriptors that define variable names, types, and roles, and includes a lazy SQL query proxy for working with database tables without loading all data into memory. The
Builds and runs interactive data analysis workflows on a visual canvas without writing code.
Live-Charts 是一个 .NET 数据可视化库,提供了一系列交互式图表、地图和仪表盘。它作为一个实时图表引擎和多格式图形库,旨在在 .NET 应用程序中渲染复杂数据集。 该库具有用于创建能够探索大型数据集的交互式数据仪表盘的工具。这由一个用于缩放、平移和利用多个坐标轴来导航数十万个数据点的系统所支持。 该可视化引擎支持多种格式,包括柱状图、折线图、热力图和地理地图。它包括用于实时数据监控和开发桌面仪表盘以跟踪实时指标和趋势的功能。
Offers interactive visual tools for graphically analyzing and exploring massive datasets through zooming and panning.
dlt 是一个 Python 数据摄取工具和 ETL 流水线框架,旨在从不同来源获取数据并将其持久化到结构化目标中。它作为一个模式推断引擎,可自动检测数据类型并将嵌套的 JSON 结构扁平化为关系表,将数据从源端移动到数据湖、数据仓库或向量数据库。 该项目通过 AI 驱动的流水线生成脱颖而出,利用大语言模型为 REST API 构建提取代码和连接器。它还支持多模态向量存储和向量数据库的专门填充,以支持 AI 和机器学习应用。 该框架涵盖了广泛的功能,包括自动化模式演进、通过状态跟踪进行增量数据加载,以及通过强制执行数据契约进行数据质量验证。它提供了用于关系数据规范化、加载前后转换的工具,以及针对 SQL 数据库和云对象存储的多种目标适配器。 可观测性通过流水线执行仪表板、列血缘跟踪以及使用基于内容的哈希进行模式版本验证来处理。
Connects datasets to dashboards to automatically generate charts based on the inferred schema.
该项目是一个全面的教育资源和技术手册,专注于可解释机器学习和可解释 AI(XAI)。它作为一本教科书和参考资料,用于实现使复杂的机器学习模型对人类透明且易于理解的技术。 该资源提供了关于构建本质上透明的模型(如决策树和稀疏线性模型)以及将事后解释方法应用于黑盒系统的指导。它详细介绍了量化特征重要性、为单个预测生成理由以及使用代理模型近似复杂决策过程的具体方法。 内容涵盖了广泛的分析功能,包括全局和局部特征影响分析、计算机视觉可解释性以及使用 Shapley 值等博弈论贡献。它还通过可解释性评估、识别模型捷径的调试工作流以及透明算法结构的设计来解决模型评估问题。 该项目以 Jupyter Notebooks 集合的形式实现。
Measures the difference between a subset of prototypes and the overall data distribution.
dtale 是一个基于 Web 的 pandas 数据框交互式网格与可视化工具,设计为探索性数据分析工具。它提供了一个基于浏览器的界面用于分析表格数据结构,允许用户在无需编写手动代码的情况下计算统计数据、检测异常值并计算相关性。 该项目作为嵌入式数据查看器运行,可通过 iframe 或自定义路由集成到 Web 应用中,并对 Django、Flask 与 Streamlit 提供特定支持。它通过交互式数据网格与能够生成直方图、箱线图与 3D 散点图的数据可视化库的组合,实现了对数据集的探索。 该平台涵盖了广泛的数据管理与分析能力,包括表格数据清理、重塑与交互式过滤。它包括用于缺失数据分析、相关性计算与预测能力评分的观测工具。对于会话管理,它支持多实例追踪与跨并发工作进程的状态持久化。 该界面受用户名与密码认证保护,并支持从分隔文件、电子表格与 ArcticDB 数据存储中进行数据摄入。
Provides a visual interface for the interactive exploration and analysis of tabular dataframes.
Epoch 是一个 CSS 可样式化的图表引擎和可视化库,专为实时和统计数据设计。它作为一个时间序列图表工具,使用 SVG 和 HTML5 Canvas 图形的混合体来渲染历史和实时数据,以在频繁更新期间保持性能。 该库通过一个统一的 CSS 查询系统脱颖而出,该系统将样式应用于矢量和栅格绘图元素。这允许通过 CSS 类进行视觉主题解析,并能够使用样式表自定义特定数据序列的外观。 该工具集涵盖了广泛的可视化类型,包括用于趋势分析的折线图、面积图、柱状图和热力图,以及用于仪表盘的仪表盘、饼图和分组柱状图。它还通过使用离散桶分组和颜色混合来显示数据集中度的散点图和直方图,提供了统计探索功能。
Offers scatter plots and histograms with discrete bucket grouping to explore statistical correlations and data concentrations.
Embedding Atlas 是一个基于 Web 的界面,用于渲染高维向量嵌入并通过交互式视觉聚类分析复杂数据集。它作为高维数据分析器,用于发现趋势和密度模式,并充当向量相似度浏览器,以定位大规模嵌入数据集中的最近邻数据点。 该项目提供了一个同步的多模态数据仪表板,将表格数据与图像、音频和文本链接起来。它利用硬件加速渲染来显示数百万个嵌入点,并采用高维投影映射来揭示全局数据结构和聚类。 该工具包涵盖了广泛的分析功能,包括实时相似度搜索、最近邻空间索引以及跨链接仪表板的状态同步。它还包括用于自动化数据探索的接口,允许控制器以编程方式执行查询并更新可视化图表。
Enables AI agents to execute SQL commands and update visual charts for programmatic analysis of embedded data.