awesome-repositories.com
Blog
MCP
awesome-repositories.com

Discover the best open-source repositories with AI-powered search.

ExploreCurated searchesOpen-source alternativesSelf-hosted softwareBlogSitemap
ProjectMCP serverAboutHow we rankPress
LegalPrivacyTerms
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
pandas-profiling avatar

pandas-profiling/pandas-profiling

0
View on GitHub↗
docs.sdk.ydata.ai↗

Pandas Profiling

This project is an exploratory data analysis library and profiling tool for Pandas and Spark DataFrames. It automates the initial investigation of datasets by generating comprehensive descriptive analysis reports, statistical summaries, and data quality warnings.

The system functions as a data quality profiler to detect missing values, duplicate rows, and type inconsistencies. It includes a dataset comparison tool for identifying structural and content shifts between different versions of the same data, as well as specialized tools for time-series analysis to calculate auto-correlation and seasonality.

The analytical surface covers automated text analysis for detecting scripts and character blocks, and metadata extraction for files and images. Results can be exported as HTML files, JSON structures, or interactive notebook widgets.

The library can be used through a Python API or via a command-line interface for processing CSV files using configuration files.

AI search

Explore more awesome repositories

Describe what you need in plain English — the AI ranks thousands of curated open-source projects by relevance.

Start searching with AI

Features

  • Profiling Reports - Provides comprehensive statistical summaries and data quality assessments generated directly from Pandas and Spark dataframes.
  • Automated Exploratory Analysis - Automatically generates statistical summaries and visual insights to facilitate the initial investigation of datasets.
  • Dataset Comparators - Provides a comparative reporting tool to identify structural and content shifts between different versions of a dataset.
  • Dataframe Processing - Implements a structured pipeline that processes Pandas and Spark dataframes through sequential statistical and type-inference stages.
  • Data Quality Profilers - Identifies missing values, duplicate rows, and type inconsistencies to ensure tabular dataset integrity.
  • Time Series Analysis - Calculates time-dependent statistics including auto-correlation, seasonality, and partial auto-correlation plots.
  • Modular Analyzers - Utilizes a modular architecture with independent pluggable analyzers to compute various statistical metrics and quality indicators.
  • Tabular Data Type Inference - Automatically determines the semantic data types of columns by analyzing patterns and distributions within tabular data.
  • Text Analysis Tools - Analyzes textual columns to identify common categories, character blocks, and scripts.
  • JSON Serializers - Serializes all calculated profiling results into JSON format to decouple data analysis from the final visual report.
  • Analysis Result Exporters - Exports profiling results into various formats including HTML files, JSON, and interactive notebook widgets.
  • Profiling Executables - Includes a command-line interface for processing CSV files and generating reports without requiring custom Python code.
  • Configuration-Driven Analysis - Provides an external configuration system to control the depth and specific calculators used during the profiling process.
  • HTML Template Renderers - Generates comprehensive visual reports by injecting profiling metadata into predefined HTML and CSS templates.
  • Statistics - Automated HTML profiling reports for dataframes.
  • Python Visualization - Generates statistical analytic reports with integrated visualizations.
  • Python Visualization Libraries - Generates statistical reports and visualizations for data analysis.
13,609 stars·1,792 forks·Python·MIT·30 views

Star history

Star history chart for pandas-profiling/pandas-profilingStar history chart for pandas-profiling/pandas-profiling

How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.

Frequently asked questions

What does pandas-profiling/pandas-profiling do?

This project is an exploratory data analysis library and profiling tool for Pandas and Spark DataFrames. It automates the initial investigation of datasets by generating comprehensive descriptive analysis reports, statistical summaries, and data quality warnings.

What are the main features of pandas-profiling/pandas-profiling?

The main features of pandas-profiling/pandas-profiling are: Profiling Reports, Automated Exploratory Analysis, Dataset Comparators, Dataframe Processing, Data Quality Profilers, Time Series Analysis, Modular Analyzers, Tabular Data Type Inference.

Which projects share features with pandas-profiling/pandas-profiling?

Projects with overlapping indexed features include: ydataai/pandas-profiling — This project is an exploratory data analysis framework and profiling tool designed to generate comprehensive… data-centric-ai-community/fg-data-profiling — This project is a data profiling and exploratory data analysis tool designed to generate automated quality reports for… ydataai/ydata-profiling — Ydata-profiling is an automated exploratory data analysis framework designed to generate comprehensive statistical… data-centric-ai-community/ydata-profiling — This library provides a diagnostic toolkit for automated data profiling and exploratory analysis. It generates… donnemartin/data-science-ipython-notebooks — This project is a collection of interactive Python notebooks and educational resources designed for mastering data… evidentlyai/evidently — Evidently is an AI observability platform and evaluation framework designed to quantify the performance of machine…

Projects sharing features with Pandas Profiling

These projects share indexed features with Pandas Profiling. Shared tags can include platform or build tooling; verify the primary use case before treating a result as a replacement.
  • ydataai/pandas-profilingydataai avatar

    ydataai/pandas-profiling

    13,610View on GitHub↗

    This project is an exploratory data analysis framework and profiling tool designed to generate comprehensive statistical reports from Pandas and Spark DataFrames. It functions as a data quality profiler that identifies missing values, duplicates, and high correlations within tabular datasets. The tool distinguishes itself through specialized capabilities for time-series analysis, extracting temporal statistics, seasonality, and auto-correlation plots. It also includes a dataset comparison utility to identify structural or content changes between different versions of a dataset. The analysis

    Python
    View on GitHub↗13,610
  • data-centric-ai-community/fg-data-profilingData-Centric-AI-Community avatar

    Data-Centric-AI-Community/fg-data-profiling

    13,609View on GitHub↗

    This project is a data profiling and exploratory data analysis tool designed to generate automated quality reports for Pandas and Spark dataframes. It serves as a system for computing descriptive statistics, identifying correlations, and analyzing univariate and multivariate data patterns. The tool provides specialized capabilities for comparing different versions of datasets to identify changes in data quality and distributions. It includes a dedicated profiler for time-dependent data to extract statistical information such as seasonality and auto-correlation. The software covers a broad an

    Python
    View on GitHub↗13,609
  • ydataai/ydata-profilingydataai avatar

    ydataai/ydata-profiling

    13,755View on GitHub↗

    Ydata-profiling is an automated exploratory data analysis framework designed to generate comprehensive statistical reports and visual summaries from dataframes. It functions as a diagnostic tool for assessing data quality, identifying missing values, duplicates, and outliers, while providing a scalable engine for profiling massive datasets across distributed enterprise environments. The project distinguishes itself through its ability to handle large-scale data through distributed task orchestration and lazy stream processing, which minimizes memory overhead during complex computations. It in

    Pythonbig-data-analyticsdata-analysisdata-exploration
    View on GitHub↗13,755
  • data-centric-ai-community/ydata-profilingData-Centric-AI-Community avatar

    Data-Centric-AI-Community/ydata-profiling

    13,618View on GitHub↗

    This library provides a diagnostic toolkit for automated data profiling and exploratory analysis. It generates comprehensive statistical summaries and visual reports for tabular datasets, enabling users to identify distribution patterns, missing values, and quality anomalies through a unified interface. The project distinguishes itself by offering differential analysis, which allows for the comparison of two dataset versions to track structural and statistical changes over time. It supports large-scale data processing through lazy evaluation and provides interactive widgets that embed directl

    Python
    View on GitHub↗13,618
Compare all 30 related projects→