27 repositorios
Methods for filling gaps in datasets using scalar replacement or propagation.
Distinguishing note: Focuses on filling missing values rather than identification or removal.
Explore 27 awesome GitHub repositories matching data & databases · Missing Data Imputation. Refine with filters or upvote what's useful.
Pandas is a high-performance data analysis library that provides a comprehensive framework for manipulating, cleaning, and transforming structured datasets. It centers on labeled one-dimensional and two-dimensional data structures, allowing users to construct, filter, and reshape tabular information while performing complex arithmetic and logical operations. The library distinguishes itself through a sophisticated indexing engine that enables automatic data alignment during calculations and relational merges. By utilizing a block-based memory layout, it optimizes cache locality for vectorized
Enables replacing missing values with scalars or propagating existing values to fill gaps.
Polars is a high-performance columnar data processing library designed for efficient analytical workflows. It functions as a structured data library that organizes information into typed columns, utilizing the Apache Arrow memory format to enable zero-copy data sharing and cache-friendly, vectorized operations. The engine is built to handle large-scale tabular datasets, providing both local and distributed analytical runtimes that scale from single-machine environments to multi-node clusters. The project distinguishes itself through a sophisticated lazy query engine that constructs abstract e
Replaces null values using literal values, computed expressions, or interpolation methods.
This project is an educational platform and research toolkit designed to teach deep learning through a combination of mathematical theory, visual diagrams, and executable code. It provides a comprehensive environment for building, training, and evaluating neural networks, grounding complex concepts in interactive computational notebooks that allow for hands-on experimentation. The framework distinguishes itself by interleaving theoretical foundations—including linear algebra, calculus, and probability—with practical implementations across multiple industry-standard libraries. It supports flex
Handles incomplete records by imputing missing values with statistical estimates or converting gaps into indicator features.
Fastai is a high-level deep learning library built on PyTorch that provides a unified interface for managing the entire machine learning lifecycle. It functions as a comprehensive training toolkit, abstracting hardware management and automating complex training loops to simplify the construction and execution of neural network models. The framework is distinguished by its notebook-centric development environment and a type-dispatching data pipeline that automatically applies transformations based on input data formats. It emphasizes transfer learning through discriminative layer-wise optimiza
Fills gaps in continuous data columns using strategies like median or mode to ensure complete datasets.
Backtrader is a Python framework designed for the development, backtesting, and live execution of algorithmic trading strategies. It provides a comprehensive environment for quantitative finance, allowing users to simulate trading logic against historical market data or connect directly to brokerage platforms for automated real-time trading. The project distinguishes itself through a unified event-driven architecture that treats backtesting and live trading with the same API. This consistency is supported by a flexible data-feed abstraction layer that normalizes diverse financial sources, ena
Populates missing time intervals in financial data feeds using configurable price and volume values.
This project is a machine learning algorithm reference and implementation guide that provides theoretical foundations and code for supervised learning, deep learning, and natural language processing. It serves as a comprehensive toolkit for implementing predictive models and a technical reference for algorithm engineering. The project focuses on ensemble learning frameworks, including the construction of decision trees, random forests, and gradient boosting models. It also functions as a probabilistic graphical model library and an NLP algorithm reference, with specific implementations for se
Fills missing data by iteratively estimating values based on classification path similarity within a forest.
Statsmodels is a comprehensive Python library designed for statistical modeling, econometric research, and data analysis. It provides a robust framework for estimating and diagnosing a wide range of statistical models, enabling users to perform rigorous hypothesis testing, regression analysis, and complex data exploration within structured environments. The library distinguishes itself through its support for advanced statistical methodologies, including state space representation for dynamic systems and generalized linear frameworks that accommodate non-normal response variables. It offers s
Fills gaps in datasets using multiple imputation methods to ensure data integrity.
This project is a framework for the efficient serialization and deserialization of data structures. It provides a unified, macro-based interface that automates the conversion of complex internal objects into standardized formats and reconstructs them from raw input streams or buffers. By leveraging compile-time code generation, the library minimizes manual implementation overhead while ensuring consistent logic across diverse data types. The framework distinguishes itself through a format-agnostic data model and a visitor-based parsing architecture that decouples data structures from specific
Automatically populates missing fields with default values during the deserialization process.
PyMC is a Bayesian probabilistic programming framework used for building probabilistic models and performing Bayesian inference. It provides a probabilistic graphical model library for specifying random variables, priors, and likelihood functions, supported by an MCMC sampling engine and variational inference tools to estimate posterior distributions. The framework features a GPU-accelerated inference backend that compiles models into machine code to increase execution speed. It utilizes a backend-agnostic tensor execution model and just-in-time graph compilation to optimize the computation o
Estimates missing values within datasets using probabilistic frameworks to maintain uncertainty.
tsfresh is an automated feature engineering tool and library designed to extract statistical characteristics from raw time series data. It transforms sequential data into tabular datasets, converting time series into a flat format where each row represents a unique entity and columns represent extracted features. The project distinguishes itself through a parallel data processing framework that distributes heavy computational workloads across multiple CPU cores. It also implements hypothesis-based feature selection to identify the most predictive characteristics and filter out irrelevant ones
Fills gaps in extracted feature sets using specialized transformers to maintain compatibility with ML models.
This project is a Python financial analytics framework and quantitative trading library. It provides a suite of mathematical tools for asset pricing, statistical market analysis, and the development of algorithmic trading strategies. The library is distinguished by its focus on currency and commodity correlation modeling, using regression and normalization to identify exchange rate drivers. It features a specialized portfolio optimization engine that applies graph theory, such as clique centrality and degeneracy ordering, alongside quadratic programming to balance risk-adjusted returns. The
Fills gaps in pricing datasets by applying synthetic control methods based on similar economic entities.
Handles missing values natively in raw tabular input without requiring any preprocessing or imputation.
tsai es una librería de deep learning para clasificación, regresión y pronóstico de series temporales. Construida sobre PyTorch y fastai, proporciona un framework para asignar etiquetas a datos secuenciales, predecir valores futuros en secuencias univariantes o multivariantes y entrenar representaciones en datos sin etiquetar mediante aprendizaje autosupervisado. La librería destaca por sus capacidades especializadas de ingeniería temporal y escalado. Incluye herramientas para codificación temporal cíclica que capturan patrones estacionales y segmentación de ventanas en línea para procesar datasets que superan la memoria disponible. También admite pipelines de entrada multimodal que combinan características categóricas estáticas con secuencias continuas dinámicas. El toolkit cubre una amplia gama de necesidades de preprocesamiento y evaluación, incluyendo segmentación por ventana deslizante, imputación de datos faltantes y conversión de dataframes tabulares en tensores estructurados. El rendimiento del modelo se evalúa mediante validación walk-forward y análisis de importancia de características para garantizar la consistencia temporal.
Fills gaps in sequential datasets using estimation techniques to ensure continuity for downstream modeling.
OSMnx es una biblioteca de Python para descargar, modelar y analizar redes de calles y otras características geoespaciales de OpenStreetMap. Permite a los usuarios recuperar y trabajar con datos de infraestructura del mundo real en cualquier parte del mundo, proporcionando herramientas para el análisis de redes, consultas espaciales y visualización. La biblioteca ofrece capacidades para trabajar con características urbanas como huellas de edificios, paradas de tránsito y datos de elevación, junto con estadísticas de red como densidad de intersecciones y circuitos. Admite múltiples modos de viaje, incluidos conducir, caminar y andar en bicicleta, y puede calcular rutas más cortas, imputar velocidades de viaje y generar mapas de isolíneas. La funcionalidad adicional incluye geocodificación, coincidencia de mapas, proyección de coordenadas y la capacidad de guardar y cargar redes en varios formatos. OSMnx proporciona herramientas para visualizar redes de calles y características geoespaciales como mapas estáticos o mapas web interactivos, y puede trazar diagramas de figura-fondo. La biblioteca está disponible a través de métodos de instalación de paquetes de Python estándar.
Imputes missing travel speeds and calculates edge travel times for street network routing.
Este proyecto es un recurso educativo integral sobre machine learning y una serie de tutoriales presentados como una colección de Jupyter Notebooks interactivos. Proporciona implementaciones prácticas en Python para el ciclo de vida completo del machine learning, cubriendo aprendizaje supervisado y no supervisado, deep learning y aprendizaje por refuerzo. El recurso destaca por ofrecer guías de implementación detalladas para arquitecturas complejas, incluyendo transformers, redes generativas antagónicas (GAN) y redes neuronales convolucionales. También incluye material especializado para desarrollar agentes de aprendizaje por refuerzo utilizando Q-learning y Deep Q-Networks en entornos simulados. El contenido abarca una amplia gama de capacidades de ciencia de datos, incluyendo pipelines de ingeniería de datos, codificación de características y reducción de dimensionalidad. Proporciona material extenso sobre evaluación de modelos mediante validación cruzada y métricas de diagnóstico, así como temas avanzados como procesamiento de lenguaje natural, análisis de sentimiento e IA generativa. Todo el plan de estudios está diseñado para su ejecución interactiva dentro de Jupyter Notebooks, combinando código ejecutable, texto enriquecido y visualizaciones.
Provides methods for filling gaps in tabular datasets using scalar replacement or statistical propagation.
Este proyecto es una colección completa de materiales educativos de programación en Python, incluyendo tutoriales, ejercicios y muestras de código curadas. Sirve como un plan de estudios de aprendizaje y kit de herramientas de ingeniería de software, utilizando Jupyter Notebooks para combinar código ejecutable con texto educativo descriptivo. El repositorio proporciona guías de implementación prácticas para construir aplicaciones de modelos de lenguaje grandes, como sistemas de generación aumentada por recuperación, agentes de IA con estado y flujos de trabajo de aprendizaje automático. Se distingue por ofrecer un enfoque estructurado para flujos de trabajo de codificación agentica, cubriendo destilación de ventana de contexto, enrutamiento de modelos agnóstico al proveedor y salidas estructuradas forzadas por esquema. Los materiales cubren una amplia gama de capacidades de ingeniería de software, incluyendo programación asíncrona con colas de tareas distribuidas, desarrollo de aplicaciones web con API REST y flujos de trabajo de análisis de datos. También incluye recursos para dominar el diseño orientado a objetos, implementar tuberías de CI/CD y aplicar estándares profesionales de linting y formato.
Provides techniques for filling missing values in datasets using scalar replacement or propagation.
Vega-Lite is a high-level declarative language for specifying interactive, multi-view visualizations. It compiles a concise JSON specification into a full Vega visualization, automatically inferring scales, axes, and legends from encoding declarations. The grammar-of-graphics encoding maps data fields to visual channels such as position, color, size, and shape, while a multi-view composition grammar enables layered, faceted, concatenated, and repeated layouts. Reactive parameter binding links named parameters to input widgets, selections, and expressions for dynamic updates. The project suppo
Vega-Lite fills missing data values by generating new data points using a constant value or statistical methods within groups.
This is an interactive notebook-based course that teaches machine learning from Python fundamentals through deep learning and natural language processing. It uses real datasets and multiple frameworks within a structured, hands-on curriculum that combines concise explanations with executable code cells, built-in datasets, and embedded exercise checkpoints. Learning progresses through data preparation and exploration, classical machine learning workflows, computer vision with convolutional neural networks, and natural language processing with deep learning, all delivered as a cohesive progressi
Implements methods for detecting and filling gaps in datasets using scalar replacement and interpolation.
Connexion es un framework basado en especificaciones para construir APIs que mapea automáticamente las especificaciones OpenAPI a la lógica de la aplicación. Utiliza estas especificaciones para automatizar el enrutamiento, la validación de solicitudes y la serialización de respuestas, vinculando las operaciones de la API a funciones de manejo backend a través de IDs de operación. El proyecto se diferencia al proporcionar un servidor mock basado en esquemas que simula el comportamiento de la API utilizando respuestas de ejemplo de la especificación sin requerir lógica backend. También incluye un sistema de alojamiento de documentación dinámica que traduce la especificación de la API en una consola interactiva en vivo para explorar y probar endpoints. El framework cubre áreas de capacidad amplias, incluyendo la aplicación de seguridad mediante autenticación basada en middleware y validación de alcance (scope), lógica de validación de solicitudes y respuestas conectable, e inyección automática de parámetros en argumentos de función tipados. También proporciona utilidades para la gestión del ciclo de vida de la aplicación, integración de middleware personalizado y simulación de solicitudes para pruebas. El proyecto puede utilizarse para arrancar aplicaciones web independientes o envolver frameworks existentes para añadir capacidades basadas en especificaciones.
Populates missing fields in incoming request bodies using default values specified in the API definition.
This project is a collection of comprehensive guides and reference materials designed for technical interviews, machine learning system design, and professional development. It serves as a technical knowledge base and a career coaching manual, providing structured resources to help candidates navigate the machine learning hiring landscape. The resource distinguishes itself by offering detailed frameworks for comparing industry roles, analyzing company types, and planning long-term career progression. It provides specific guidance on evaluating employer organizational health, identifying resea
Detects anomalous data points and decides whether to remove, cap, or transform them.