5 个仓库
Performing quality checks and exploratory analysis on distributed tabular datasets.
Distinct from Dataframe Processing: Focuses on the analysis of Spark DataFrames specifically, whereas Dataframe Processing is general programmatic manipulation.
Explore 5 awesome GitHub repositories matching data & databases · Distributed Dataframe Analysis. Refine with filters or upvote what's useful.
This project is a data profiling and exploratory data analysis tool designed to generate automated quality reports for Pandas and Spark dataframes. It serves as a system for computing descriptive statistics, identifying correlations, and analyzing univariate and multivariate data patterns. The tool provides specialized capabilities for comparing different versions of datasets to identify changes in data quality and distributions. It includes a dedicated profiler for time-dependent data to extract statistical information such as seasonality and auto-correlation. The software covers a broad an
Implements large-scale data quality checks and exploratory analysis specifically for Spark DataFrames.
Perspective is a columnar data analytics engine and high-performance visualization component powered by WebAssembly. It provides a system for analyzing and visualizing large or streaming datasets through interactive data grids and charts, utilizing a compiled binary to achieve near-native performance within the browser. The project distinguishes itself through a WebSocket-based data streaming interface and deep Apache Arrow integration, which minimize memory overhead when synchronizing tables between servers and clients. It acts as a remote query proxy capable of translating visualization con
Exposes in-memory Polars DataFrames to browser clients over a WebSocket connection for remote analysis.
Pixie is an open-source observability platform for Kubernetes that uses eBPF to automatically capture telemetry data from clusters without requiring any manual instrumentation or code changes. It functions as an eBPF telemetry collector, a continuous application profiler, a network traffic analyzer, and a scriptable telemetry query engine, all within a single Kubernetes-native tool. The platform distinguishes itself through several integrated capabilities. It continuously samples stack traces from compiled-language code to identify CPU performance bottlenecks, visualizing the results as inter
Transforms tabular telemetry data through immutable dataframe operations for observability analysis.
这是一个 Python 数据分析库和探索性数据分析框架,专为处理原始数据集而设计。它提供了一套用于检查数据、识别异常并应用统计方法以发现模式的工具。 该仓库作为一个机器学习建模工具包和统计数据建模套件。它包括用于分析数据变量之间关系并从复杂数据集中获取见解的预测算法和数学模型。 该项目涵盖了广泛的功能,包括数据科学、机器学习建模和探索性数据分析。这些功能通过数据操作、数值计算和数据可视化实现。
Provides capabilities to perform numerical transformations and filtering on tabular data structures to derive insights.
This is a comprehensive Python programming course and technical curriculum designed to take users from foundational syntax to advanced development patterns. It serves as a multi-disciplinary educational suite covering programming fundamentals, object-oriented design, and data analysis. The project provides specialized guides on professional development techniques, including the use of decorators, generators for memory management, and dunder-method operator overloading. It also includes instructional material on executing parallel tasks through concurrency and multiprocessing to reduce executi
Provides a suite for loading structured datasets and performing numerical transformations using DataFrames.