12 repositorios
Tools for cleaning, transforming, and encoding data for model consumption.
Distinguishing note: Focuses on categorical encoding.
Explore 12 awesome GitHub repositories matching artificial intelligence & ml · Data Preprocessing. Refine with filters or upvote what's useful.
This project is an interactive data science environment that combines code execution, rich media visualization, and narrative documentation into a persistent, browser-based platform. It serves as a comprehensive educational resource for scientific computing, providing a framework for iterative data analysis and machine learning prototyping. The environment is distinguished by its focus on high-performance numerical computing, utilizing vectorized array operations and memory-mapped data structures to handle large-scale computations efficiently. It features a unified estimator interface that st
Converts categorical data into numerical formats for model input.
DeepSeek-Coder is a large language model and foundational neural network architecture designed specifically for software development tasks. It functions as an artificial intelligence assistant capable of interpreting complex programming instructions to generate, transpile, and structure source code. The system distinguishes itself through its ability to perform project-level code generation, analyzing broader context and patterns across entire software projects rather than isolated files. It supports multimodal input processing, allowing for the integration of text and visual data to inform i
Formats raw data through truncation, padding, and token insertion to meet model architecture requirements.
This project is a cross-platform machine learning inference engine designed to execute pre-trained models across diverse operating systems and hardware environments. It functions as a standardized execution framework that manages the entire lifecycle of model inference, from loading and graph optimization to hardware-accelerated execution and generative sequence management. The runtime distinguishes itself through a highly modular architecture that decouples model logic from hardware-specific kernels. By utilizing an execution provider abstraction, it enables developers to offload computation
Transforms raw inputs like text or images into tensor formats required by models using integrated operators.
AutoGluon is an automated machine learning framework and multimodal library designed to automate the end-to-end pipeline from data preprocessing to high-accuracy model training and validation. It functions as an automated model trainer for tabular, image, text, and time series data, as well as a tool for time series forecasting and foundation model finetuning. The project is distinguished by its ability to jointly process and fuse different data types, allowing for the construction of multimodal neural networks that integrate images, text, and structured tables. It supports zero-shot inferenc
Stores transformed data to skip the preprocessing stage during repeated prediction calls.
CatBoost is a gradient boosting machine learning library used to train decision tree ensembles for regression, classification, and ranking tasks. It functions as a high-performance framework that provides a categorical data processor for transforming non-numeric features, a distributed trainer for large-scale datasets, and GPU acceleration to speed up model construction. The library distinguishes itself through native handling of categorical data and text features, removing the need for manual encoding. It includes a specialized model interpretability tool that leverages SHAP values and featu
Uses specialized categorical data types during input preparation to speed up the preprocessing of categorical features.
This project is a manifold learning and non-linear dimensionality reduction library used to project high-dimensional data into lower-dimensional spaces while preserving topological structure. It functions as a parametric embedding framework and a topological data visualization library for identifying clusters and patterns within complex datasets. The library distinguishes itself through parametric neural mapping, which uses neural networks to learn functional mappings that allow for out-of-sample projections and the reconstruction of original data. It supports supervised and semi-supervised d
Reduces high-dimensional data to a lower-dimensional manifold to improve density-based clustering performance.
This project is a machine learning educational resource and implementation guide for Python. It provides a collection of executable code and notebooks that demonstrate predictive modeling, data analysis workflows, and the implementation of various machine learning algorithms. The repository features practical examples of classification, regression, and clustering tasks using Scikit-Learn, alongside tutorials for building and training deep learning architectures with TensorFlow. These include implementations of convolutional and recurrent networks. The content covers a broad range of capabili
Provides workflows for cleaning, scaling, and encoding raw datasets to prepare them for machine learning.
Este es un plan de estudios educativo integral diseñado para enseñar los fundamentos del aprendizaje automático utilizando el lenguaje de programación Python. Proporciona un curso estructurado que cubre la implementación y la teoría del aprendizaje supervisado, el aprendizaje no supervisado y el aprendizaje profundo. El plan de estudios se imparte a través de notebooks interactivos que combinan código ejecutable con tutoriales técnicos. Incluye guías dedicadas para construir arquitecturas de redes neuronales, implementar modelos de clasificación y regresión, y utilizar técnicas de clustering para el descubrimiento de patrones en datos no etiquetados. Los materiales cubren el flujo de trabajo completo de aprendizaje automático, incluyendo el preprocesamiento de datos y la codificación categórica, el entrenamiento de modelos y el ajuste de hiperparámetros, y la evaluación del rendimiento. También cuenta con herramientas para visualizar el comportamiento del modelo, como el trazado de límites de decisión y diagramas de árboles de decisión.
Provides a comprehensive workflow for cleaning, transforming, and encoding data to prepare it for machine learning models.
Anomalib is a PyTorch-based library for visual anomaly detection, offering a modular framework, a comprehensive model zoo, and a benchmarking suite designed for industrial defect detection. It provides a wide range of algorithms—including generative, discriminative, teacher-student, and vision-language approaches—that support unsupervised, few-shot, and zero-shot settings. The library enables deployment through model export to ONNX and OpenVINO for edge devices, and includes a no-code web application for training and inference. It also features a command-line interface for orchestrating multi
Anomalib applies transformations to raw images before passing them to the anomaly detection model.
Orange3 is a visual data mining platform that provides an interactive canvas for building data analysis workflows without writing code. At its core, it offers a widget-based visual programming environment where users connect configurable components to perform data preprocessing, machine learning model training, statistical evaluation, and interactive visualization. The platform is built on NumPy-backed data tables with domain descriptors that define variable names, types, and roles, and includes a lazy SQL query proxy for working with database tables without loading all data into memory. The
Applies transformations such as normalization, imputation, or feature selection to prepare data for modeling.
Este proyecto es un recurso educativo integral y un curso para construir redes neuronales usando PyTorch. Cubre los bloques de construcción fundamentales del deep learning, incluyendo la manipulación de tensores, la diferenciación automática y la construcción de componentes modulares de redes neuronales. El repositorio sirve como guía técnica para varios dominios especializados. Proporciona detalles de implementación para tareas de visión artificial como clasificación de imágenes, detección de objetos y segmentación semántica, así como flujos de trabajo de procesamiento de lenguaje natural que involucran transformers, redes recurrentes y modelos generativos. Además, incluye una referencia para IA generativa, centrándose específicamente en la síntesis de imágenes mediante modelos de difusión y redes adversarias. El material se extiende a pipelines de optimización y despliegue de modelos. Cubre técnicas para reducir el tamaño del modelo y aumentar la velocidad de inferencia mediante cuantización y la exportación de modelos a formatos como ONNX y TensorRT. Otras áreas de capacidad incluyen ingeniería de datos para carga paralela, evaluación de modelos mediante métricas personalizadas y el despliegue de modelos de lenguaje grandes (LLM) de código abierto. El proyecto se entrega principalmente como una serie de Jupyter Notebooks.
Provides tools for cleaning, transforming, and encoding raw data to prepare it for model consumption.
This project is a TensorFlow meta-learning framework and research toolkit designed to implement and train learned optimizers. It provides a library of tools for developing neural networks that learn how to optimize other models, replacing traditional gradient-based optimization algorithms. The framework includes a problem ensemble manager that allows multiple distinct optimization tasks to be combined into a single weighted loss function for simultaneous training. It uses a factory pattern for network instantiation and supports the definition of custom objective functions and loss graphs as t
Transforms input gradients using logarithmic scaling and sign extraction to prepare them for model consumption.