12 Repos
Tools for cleaning, transforming, and encoding data for model consumption.
Distinguishing note: Focuses on categorical encoding.
Explore 12 awesome GitHub repositories matching artificial intelligence & ml · Data Preprocessing. Refine with filters or upvote what's useful.
This project is an interactive data science environment that combines code execution, rich media visualization, and narrative documentation into a persistent, browser-based platform. It serves as a comprehensive educational resource for scientific computing, providing a framework for iterative data analysis and machine learning prototyping. The environment is distinguished by its focus on high-performance numerical computing, utilizing vectorized array operations and memory-mapped data structures to handle large-scale computations efficiently. It features a unified estimator interface that st
Converts categorical data into numerical formats for model input.
DeepSeek-Coder is a large language model and foundational neural network architecture designed specifically for software development tasks. It functions as an artificial intelligence assistant capable of interpreting complex programming instructions to generate, transpile, and structure source code. The system distinguishes itself through its ability to perform project-level code generation, analyzing broader context and patterns across entire software projects rather than isolated files. It supports multimodal input processing, allowing for the integration of text and visual data to inform i
Formats raw data through truncation, padding, and token insertion to meet model architecture requirements.
This project is a cross-platform machine learning inference engine designed to execute pre-trained models across diverse operating systems and hardware environments. It functions as a standardized execution framework that manages the entire lifecycle of model inference, from loading and graph optimization to hardware-accelerated execution and generative sequence management. The runtime distinguishes itself through a highly modular architecture that decouples model logic from hardware-specific kernels. By utilizing an execution provider abstraction, it enables developers to offload computation
Transforms raw inputs like text or images into tensor formats required by models using integrated operators.
AutoGluon is an automated machine learning framework and multimodal library designed to automate the end-to-end pipeline from data preprocessing to high-accuracy model training and validation. It functions as an automated model trainer for tabular, image, text, and time series data, as well as a tool for time series forecasting and foundation model finetuning. The project is distinguished by its ability to jointly process and fuse different data types, allowing for the construction of multimodal neural networks that integrate images, text, and structured tables. It supports zero-shot inferenc
Stores transformed data to skip the preprocessing stage during repeated prediction calls.
CatBoost is a gradient boosting machine learning library used to train decision tree ensembles for regression, classification, and ranking tasks. It functions as a high-performance framework that provides a categorical data processor for transforming non-numeric features, a distributed trainer for large-scale datasets, and GPU acceleration to speed up model construction. The library distinguishes itself through native handling of categorical data and text features, removing the need for manual encoding. It includes a specialized model interpretability tool that leverages SHAP values and featu
Uses specialized categorical data types during input preparation to speed up the preprocessing of categorical features.
This project is a manifold learning and non-linear dimensionality reduction library used to project high-dimensional data into lower-dimensional spaces while preserving topological structure. It functions as a parametric embedding framework and a topological data visualization library for identifying clusters and patterns within complex datasets. The library distinguishes itself through parametric neural mapping, which uses neural networks to learn functional mappings that allow for out-of-sample projections and the reconstruction of original data. It supports supervised and semi-supervised d
Reduces high-dimensional data to a lower-dimensional manifold to improve density-based clustering performance.
This project is a machine learning educational resource and implementation guide for Python. It provides a collection of executable code and notebooks that demonstrate predictive modeling, data analysis workflows, and the implementation of various machine learning algorithms. The repository features practical examples of classification, regression, and clustering tasks using Scikit-Learn, alongside tutorials for building and training deep learning architectures with TensorFlow. These include implementations of convolutional and recurrent networks. The content covers a broad range of capabili
Provides workflows for cleaning, scaling, and encoding raw datasets to prepare them for machine learning.
Dies ist ein umfassender Lehrplan, der darauf ausgelegt ist, die Grundlagen des Machine Learning mit der Programmiersprache Python zu vermitteln. Er bietet einen strukturierten Kurs, der die Implementierung und Theorie von überwachtem Lernen, unüberwachtem Lernen und Deep Learning abdeckt. Der Lehrplan wird durch interaktive Notebooks vermittelt, die ausführbaren Code mit technischen Tutorials kombinieren. Er enthält dedizierte Leitfäden zum Aufbau neuronaler Netzwerkarchitekturen, zur Implementierung von Klassifizierungs- und Regressionsmodellen sowie zur Nutzung von Clustering-Techniken zur Mustererkennung in ungelabelten Daten. Die Materialien decken den gesamten Machine-Learning-Workflow ab, einschließlich Datenvorverarbeitung und kategorialer Kodierung, Modelltraining und Hyperparameter-Tuning sowie Performance-Evaluierung. Er bietet zudem Tools zur Visualisierung des Modellverhaltens, wie z. B. das Plotten von Entscheidungsgrenzen und Entscheidungsbaumdiagrammen.
Provides a comprehensive workflow for cleaning, transforming, and encoding data to prepare it for machine learning models.
Anomalib is a PyTorch-based library for visual anomaly detection, offering a modular framework, a comprehensive model zoo, and a benchmarking suite designed for industrial defect detection. It provides a wide range of algorithms—including generative, discriminative, teacher-student, and vision-language approaches—that support unsupervised, few-shot, and zero-shot settings. The library enables deployment through model export to ONNX and OpenVINO for edge devices, and includes a no-code web application for training and inference. It also features a command-line interface for orchestrating multi
Anomalib applies transformations to raw images before passing them to the anomaly detection model.
Orange3 is a visual data mining platform that provides an interactive canvas for building data analysis workflows without writing code. At its core, it offers a widget-based visual programming environment where users connect configurable components to perform data preprocessing, machine learning model training, statistical evaluation, and interactive visualization. The platform is built on NumPy-backed data tables with domain descriptors that define variable names, types, and roles, and includes a lazy SQL query proxy for working with database tables without loading all data into memory. The
Applies transformations such as normalization, imputation, or feature selection to prepare data for modeling.
Dieses Projekt ist eine umfassende Lehrressource und ein Kurs zum Aufbau neuronaler Netze mit PyTorch. Es deckt die grundlegenden Bausteine des Deep Learning ab, einschließlich Tensor-Manipulation, automatischer Differenzierung und der Konstruktion modularer Komponenten für neuronale Netze. Das Repository dient als technischer Leitfaden für verschiedene spezialisierte Bereiche. Es bietet Implementierungsdetails für Computer-Vision-Aufgaben wie Bildklassifizierung, Objekterkennung und semantische Segmentierung sowie Workflows für die Verarbeitung natürlicher Sprache (NLP) mit Transformern, rekurrenten Netzen und generativen Modellen. Zudem enthält es eine Referenz für generative KI, mit Fokus auf die Synthese von Bildern mittels Diffusionsmodellen und adversarialen Netzwerken. Das Material erstreckt sich auf Modelloptimierung und Deployment-Pipelines. Es behandelt Techniken zur Reduzierung der Modellgröße und zur Erhöhung der Inferenzgeschwindigkeit durch Quantisierung und den Export von Modellen in Formate wie ONNX und TensorRT. Weitere Kompetenzbereiche umfassen Data Engineering für paralleles Laden, Modellevaluierung mittels benutzerdefinierter Metriken und das Deployment von Open-Source Large Language Models. Das Projekt wird primär als eine Reihe von Jupyter Notebooks bereitgestellt.
Provides tools for cleaning, transforming, and encoding raw data to prepare it for model consumption.
Dieses Projekt ist ein TensorFlow-Framework für Meta-Learning und ein Research-Toolkit, das darauf ausgelegt ist, gelernte Optimierer (Learned Optimizers) zu implementieren und zu trainieren. Es bietet eine Bibliothek von Tools zur Entwicklung neuronaler Netze, die lernen, wie andere Modelle optimiert werden, und ersetzt damit traditionelle gradientenbasierte Optimierungsalgorithmen. Das Framework enthält einen Problem-Ensemble-Manager, der es ermöglicht, mehrere unterschiedliche Optimierungsaufgaben für ein gleichzeitiges Training in einer einzigen gewichteten Verlustfunktion zu kombinieren. Es verwendet ein Factory-Pattern für die Netzwerk-Instanziierung und unterstützt die Definition benutzerdefinierter Zielfunktionen und Loss-Graphen als Ziele für Lernalgorithmen. Das Toolkit deckt ein breites Spektrum an Funktionen ab, einschließlich gradientenbasierter Meta-Optimierung, Modell-Benchmarking und der Ausführung von Trainingsschleifen mit konfigurierbaren Unroll-Längen. Es bietet zudem Utilities für die Gradienten-Vorverarbeitung, serialisierte Zustandspersistenz und die Berichterstattung von Experimentstatistiken wie dem mittleren Endfehler und der Epochen-Dauer.
Transforms input gradients using logarithmic scaling and sign extraction to prepare them for model consumption.