Awesome GitHub RepositoriesData Science Tooling

This project is an interactive data science environment that combines code execution, rich media visualization, and narrative documentation into a persistent, browser-based platform. It serves as a comprehensive educational resource for scientific computing, providing a framework for iterative data analysis and machine learning prototyping. The environment is distinguished by its focus on high-performance numerical computing, utilizing vectorized array operations and memory-mapped data structures to handle large-scale computations efficiently. It features a unified estimator interface that st

Netron is a visualizer for neural network and machine learning models. It provides a graphical interface that renders model architectures as interactive node-link diagrams, allowing users to inspect internal layers, tensors, and metadata. By performing static analysis, the tool enables the examination of model definitions without executing the underlying machine learning code. The software distinguishes itself through a schema-driven parsing engine that translates diverse proprietary model formats into a unified internal graph structure. This approach ensures interoperability, allowing users

Comet LLM is an observability platform and evaluation framework designed for large language model applications and agentic workflows. It functions as a system for tracing, monitoring, and debugging execution flows while providing tools for prompt optimization and the enforcement of AI safety guardrails. The platform distinguishes itself through a combination of model-based scoring and heuristic metrics to quantify output quality and detect hallucinations. It includes a dedicated prompt and agent optimizer with an interactive playground for refining templates and tool configurations. For retri

DVC is a data versioning tool and pipeline orchestrator designed to track large datasets and machine learning models. It functions as a system for managing large data artifacts by storing lightweight metadata in version control while keeping the actual binaries in a separate cache. The project serves as an experiment tracker and remote storage synchronizer, enabling the execution and comparison of machine learning iterations based on hyperparameters and performance metrics. It provides a bridge for pushing and pulling these large data artifacts between local environments and cloud or on-premi

Albumentations is a computer vision image augmentation library designed to increase training data diversity for deep learning models. It provides a toolset for applying geometric and color transformations to images and annotations, including a specialized collection of 3D operations for volumetric data used in medical and scientific imaging. The library functions as an image mask and bounding box transformer, automatically updating masks, bounding boxes, and keypoints when images undergo geometric changes. This ensures that spatial alterations remain synchronized across images and their assoc

This project is a curated collection of technical reference materials and study guides designed for machine learning interview preparation. It provides comprehensive resources for candidates pursuing engineering roles, focusing on deep learning, production infrastructure, and large-scale system design. The repository distinguishes itself through an architecture that combines theoretical research with industrial case studies. It utilizes a pattern-based approach to system design, breaking down complex deployments—such as recommendation engines, search ranking, and ad click prediction—into reus

Cleanlab is a data-centric AI library and toolkit designed to improve machine learning model performance by detecting label errors and increasing overall dataset quality. It implements a confident learning framework that iteratively refines label noise estimates by comparing model predictions with estimated label probabilities to identify mislabeled examples. The project provides specialized utilities for active learning optimization, allowing for the selection of the most impactful examples for labeling or re-labeling. It also includes an outlier detection tool to identify atypical data poin

Gridstudio is a web-based data science integrated development environment that combines a programmatic spreadsheet interface with an interactive Python environment. It functions as a system for organizing and deploying isolated data workspaces to handle data science tasks and storage. The platform merges spreadsheet data management with an execution engine for formulas and Python code, allowing for programmatic spreadsheet manipulation. It enables users to run interactive scripts and terminal sessions to clean, transform, and manage datasets within a browser. The environment supports Linux s

This repository provides a curated collection of weekly datasets designed for data visualization practice, data science education, and statistical analysis. It serves as a central source for cleaned and structured real-world data, allowing practitioners to focus on analysis and visualization without the need to scrape or clean raw files. The project facilitates a community learning workflow where users can explore a wide variety of topics, ranging from global health spending and energy datasets to maritime logs and baby name popularity. Participants are encouraged to share their resulting vis

Featuretools is an automated feature engineering library and data transformation framework written in Python. It automatically generates machine learning feature vectors from multi-table datasets by applying synthesis patterns to relational and timestamped data. The system functions as a distributed feature synthesis engine, allowing the process of creating feature vectors to scale across multiple cores or clusters to handle large-scale datasets. The library supports the synthesis of multi-table datasets, time series feature generation, and the creation of custom machine learning primitives

CML 是一个用于训练和评估机器学习模型的管道自动化工具，作为机器学习的 CI/CD 系统运行。它作为一个云计算编排器和基于 Git 的工作流管理器，通过分支管理、自动提交和集成报告来自动化模型训练周期。 该项目通过配置临时云实例或 Kubernetes 节点来提供计算密集型任务所需的专用硬件，从而脱颖而出。它还管理远程计算运行器，允许连接自托管 GPU 集群或本地机器来执行容器化机器学习工作流。 该系统涵盖了广泛的功能，包括 ML 实验跟踪（性能指标和可视化直接发布到版本控制 Pull Request 中）。它处理从初始数据导入和版本控制到生成格式化工作流报告和外部可视化链接的 ML 管道自动化。 该工具通过基于 SSH 的远程调试和恢复中断作业的能力，为基础设施管理提供了额外的实用性。

这是一个数据科学课程和教学大纲，旨在教授该领域的基本原理和工具。它提供了一套结构化的学习材料，包括 R 编程课件和统计学习指南。 这些材料侧重于数据科学的实际应用，涵盖数据清洗、可视化和探索性数据分析。它包括用于掌握线性回归、分类和无监督学习等特定技术的资源。 该课程被组织成一系列模块化的教学单元，将理论概念与可执行的代码示例相结合。这些资源涵盖了数据科学编程以及应用统计方法来分析数据集。

Neon is a deep learning framework and hardware-abstraction machine learning stack used for designing, training, and deploying neural network architectures. It functions as a graph-based computation engine that utilizes just-in-time kernel compilation to optimize machine code for tensors. The platform decouples model definitions from execution kernels, allowing it to support multiple CPU and GPU backends. This architecture enables the distribution of computational workloads across parallelized hardware environments to increase processing speed and overall efficiency. The system covers the ful

🛠 All-in-one web-based IDE specialized for machine learning and data science.

Debugging, monitoring and visualization for Python Machine Learning and Data Science

Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.

A GUI for Pandas DataFrames

Julia kernel for Jupyter

Karate Club: An API Oriented Open-source Python Framework for Unsupervised Learning on Graphs (CIKM 2020)

🏕️ Reproducible development environment for humans and agents