Awesome GitHub RepositoriesData Science Tooling

This project is an interactive data science environment that combines code execution, rich media visualization, and narrative documentation into a persistent, browser-based platform. It serves as a comprehensive educational resource for scientific computing, providing a framework for iterative data analysis and machine learning prototyping. The environment is distinguished by its focus on high-performance numerical computing, utilizing vectorized array operations and memory-mapped data structures to handle large-scale computations efficiently. It features a unified estimator interface that st

Netron is a visualizer for neural network and machine learning models. It provides a graphical interface that renders model architectures as interactive node-link diagrams, allowing users to inspect internal layers, tensors, and metadata. By performing static analysis, the tool enables the examination of model definitions without executing the underlying machine learning code. The software distinguishes itself through a schema-driven parsing engine that translates diverse proprietary model formats into a unified internal graph structure. This approach ensures interoperability, allowing users

Comet LLM is an observability platform and evaluation framework designed for large language model applications and agentic workflows. It functions as a system for tracing, monitoring, and debugging execution flows while providing tools for prompt optimization and the enforcement of AI safety guardrails. The platform distinguishes itself through a combination of model-based scoring and heuristic metrics to quantify output quality and detect hallucinations. It includes a dedicated prompt and agent optimizer with an interactive playground for refining templates and tool configurations. For retri

DVC is a data versioning tool and pipeline orchestrator designed to track large datasets and machine learning models. It functions as a system for managing large data artifacts by storing lightweight metadata in version control while keeping the actual binaries in a separate cache. The project serves as an experiment tracker and remote storage synchronizer, enabling the execution and comparison of machine learning iterations based on hyperparameters and performance metrics. It provides a bridge for pushing and pulling these large data artifacts between local environments and cloud or on-premi

Albumentations is a computer vision image augmentation library designed to increase training data diversity for deep learning models. It provides a toolset for applying geometric and color transformations to images and annotations, including a specialized collection of 3D operations for volumetric data used in medical and scientific imaging. The library functions as an image mask and bounding box transformer, automatically updating masks, bounding boxes, and keypoints when images undergo geometric changes. This ensures that spatial alterations remain synchronized across images and their assoc

This project is a curated collection of technical reference materials and study guides designed for machine learning interview preparation. It provides comprehensive resources for candidates pursuing engineering roles, focusing on deep learning, production infrastructure, and large-scale system design. The repository distinguishes itself through an architecture that combines theoretical research with industrial case studies. It utilizes a pattern-based approach to system design, breaking down complex deployments—such as recommendation engines, search ranking, and ad click prediction—into reus

Cleanlab is a data-centric AI library and toolkit designed to improve machine learning model performance by detecting label errors and increasing overall dataset quality. It implements a confident learning framework that iteratively refines label noise estimates by comparing model predictions with estimated label probabilities to identify mislabeled examples. The project provides specialized utilities for active learning optimization, allowing for the selection of the most impactful examples for labeling or re-labeling. It also includes an outlier detection tool to identify atypical data poin

Gridstudio is a web-based data science integrated development environment that combines a programmatic spreadsheet interface with an interactive Python environment. It functions as a system for organizing and deploying isolated data workspaces to handle data science tasks and storage. The platform merges spreadsheet data management with an execution engine for formulas and Python code, allowing for programmatic spreadsheet manipulation. It enables users to run interactive scripts and terminal sessions to clean, transform, and manage datasets within a browser. The environment supports Linux s

This repository provides a curated collection of weekly datasets designed for data visualization practice, data science education, and statistical analysis. It serves as a central source for cleaned and structured real-world data, allowing practitioners to focus on analysis and visualization without the need to scrape or clean raw files. The project facilitates a community learning workflow where users can explore a wide variety of topics, ranging from global health spending and energy datasets to maritime logs and baby name popularity. Participants are encouraged to share their resulting vis

Featuretools is an automated feature engineering library and data transformation framework written in Python. It automatically generates machine learning feature vectors from multi-table datasets by applying synthesis patterns to relational and timestamped data. The system functions as a distributed feature synthesis engine, allowing the process of creating feature vectors to scale across multiple cores or clusters to handle large-scale datasets. The library supports the synthesis of multi-table datasets, time series feature generation, and the creation of custom machine learning primitives

CML هي أداة لأتمتة خطوط الأنابيب لتدريب وتقييم نماذج تعلم الآلة، وتعمل كنظام CI/CD لتعلم الآلة. تعمل كمنسق للحوسبة السحابية ومدير سير عمل يعتمد على Git يقوم بأتمتة دورات تدريب النماذج من خلال إدارة الفروع، والالتزامات (commits) المؤتمتة، والتقارير المتكاملة. يتميز المشروع بتوفير نسخ سحابية مؤقتة أو عقد Kubernetes لتوفير أجهزة متخصصة للمهام كثيفة الحوسبة. كما يدير مشغلات الحوسبة عن بُعد، مما يسمح بربط مجموعات GPU ذاتية الاستضافة أو أجهزة محلية لتنفيذ سير عمل تعلم الآلة المحاوي (containerized). يغطي النظام مجموعة واسعة من الإمكانيات بما في ذلك تتبع تجارب تعلم الآلة، حيث يتم نشر مقاييس الأداء والتصورات مباشرة في طلبات السحب (pull requests) الخاصة بالتحكم في الإصدار. يتعامل مع أتمتة خط أنابيب تعلم الآلة من استيراد البيانات الأولي وإصدارها إلى إنشاء تقارير سير العمل المنسقة وروابط التصور الخارجية. توفر الأداة فائدة إضافية لإدارة البنية التحتية من خلال تصحيح الأخطاء عن بُعد عبر SSH والقدرة على استئناف المهام التي تمت مقاطعتها.

هذا المشروع عبارة عن منهج لعلوم البيانات ومقرر تعليمي مصمم لتدريس المبادئ والأدوات الأساسية لهذا المجال. يوفر مجموعة منظمة من المواد التعليمية، بما في ذلك مقررات برمجة R وأدلة للتعلم الإحصائي. تركز المواد على التطبيق العملي لعلوم البيانات، وتغطي تنظيف البيانات، والتصور، وتحليل البيانات الاستكشافي. تتضمن موارد لإتقان تقنيات محددة مثل الانحدار الخطي، والتصنيف، والتعلم غير الخاضع للإشراف. يتم تنظيم المنهج في تسلسل معياري من الوحدات التعليمية التي تدمج المفاهيم النظرية مع عينات كود قابلة للتنفيذ. تغطي هذه الموارد البرمجة لعلوم البيانات وتطبيق الأساليب الإحصائية لتحليل مجموعات البيانات.

Neon is a deep learning framework and hardware-abstraction machine learning stack used for designing, training, and deploying neural network architectures. It functions as a graph-based computation engine that utilizes just-in-time kernel compilation to optimize machine code for tensors. The platform decouples model definitions from execution kernels, allowing it to support multiple CPU and GPU backends. This architecture enables the distribution of computational workloads across parallelized hardware environments to increase processing speed and overall efficiency. The system covers the ful

🛠 All-in-one web-based IDE specialized for machine learning and data science.

Debugging, monitoring and visualization for Python Machine Learning and Data Science

Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.

A GUI for Pandas DataFrames

Julia kernel for Jupyter

Karate Club: An API Oriented Open-source Python Framework for Unsupervised Learning on Graphs (CIKM 2020)

🏕️ Reproducible development environment for humans and agents