27 repository-uri
Methods for filling gaps in datasets using scalar replacement or propagation.
Distinguishing note: Focuses on filling missing values rather than identification or removal.
Explore 27 awesome GitHub repositories matching data & databases · Missing Data Imputation. Refine with filters or upvote what's useful.
Pandas is a high-performance data analysis library that provides a comprehensive framework for manipulating, cleaning, and transforming structured datasets. It centers on labeled one-dimensional and two-dimensional data structures, allowing users to construct, filter, and reshape tabular information while performing complex arithmetic and logical operations. The library distinguishes itself through a sophisticated indexing engine that enables automatic data alignment during calculations and relational merges. By utilizing a block-based memory layout, it optimizes cache locality for vectorized
Enables replacing missing values with scalars or propagating existing values to fill gaps.
Polars is a high-performance columnar data processing library designed for efficient analytical workflows. It functions as a structured data library that organizes information into typed columns, utilizing the Apache Arrow memory format to enable zero-copy data sharing and cache-friendly, vectorized operations. The engine is built to handle large-scale tabular datasets, providing both local and distributed analytical runtimes that scale from single-machine environments to multi-node clusters. The project distinguishes itself through a sophisticated lazy query engine that constructs abstract e
Replaces null values using literal values, computed expressions, or interpolation methods.
This project is an educational platform and research toolkit designed to teach deep learning through a combination of mathematical theory, visual diagrams, and executable code. It provides a comprehensive environment for building, training, and evaluating neural networks, grounding complex concepts in interactive computational notebooks that allow for hands-on experimentation. The framework distinguishes itself by interleaving theoretical foundations—including linear algebra, calculus, and probability—with practical implementations across multiple industry-standard libraries. It supports flex
Handles incomplete records by imputing missing values with statistical estimates or converting gaps into indicator features.
Fastai is a high-level deep learning library built on PyTorch that provides a unified interface for managing the entire machine learning lifecycle. It functions as a comprehensive training toolkit, abstracting hardware management and automating complex training loops to simplify the construction and execution of neural network models. The framework is distinguished by its notebook-centric development environment and a type-dispatching data pipeline that automatically applies transformations based on input data formats. It emphasizes transfer learning through discriminative layer-wise optimiza
Fills gaps in continuous data columns using strategies like median or mode to ensure complete datasets.
Backtrader is a Python framework designed for the development, backtesting, and live execution of algorithmic trading strategies. It provides a comprehensive environment for quantitative finance, allowing users to simulate trading logic against historical market data or connect directly to brokerage platforms for automated real-time trading. The project distinguishes itself through a unified event-driven architecture that treats backtesting and live trading with the same API. This consistency is supported by a flexible data-feed abstraction layer that normalizes diverse financial sources, ena
Populates missing time intervals in financial data feeds using configurable price and volume values.
This project is a machine learning algorithm reference and implementation guide that provides theoretical foundations and code for supervised learning, deep learning, and natural language processing. It serves as a comprehensive toolkit for implementing predictive models and a technical reference for algorithm engineering. The project focuses on ensemble learning frameworks, including the construction of decision trees, random forests, and gradient boosting models. It also functions as a probabilistic graphical model library and an NLP algorithm reference, with specific implementations for se
Fills missing data by iteratively estimating values based on classification path similarity within a forest.
Statsmodels is a comprehensive Python library designed for statistical modeling, econometric research, and data analysis. It provides a robust framework for estimating and diagnosing a wide range of statistical models, enabling users to perform rigorous hypothesis testing, regression analysis, and complex data exploration within structured environments. The library distinguishes itself through its support for advanced statistical methodologies, including state space representation for dynamic systems and generalized linear frameworks that accommodate non-normal response variables. It offers s
Fills gaps in datasets using multiple imputation methods to ensure data integrity.
This project is a framework for the efficient serialization and deserialization of data structures. It provides a unified, macro-based interface that automates the conversion of complex internal objects into standardized formats and reconstructs them from raw input streams or buffers. By leveraging compile-time code generation, the library minimizes manual implementation overhead while ensuring consistent logic across diverse data types. The framework distinguishes itself through a format-agnostic data model and a visitor-based parsing architecture that decouples data structures from specific
Automatically populates missing fields with default values during the deserialization process.
PyMC is a Bayesian probabilistic programming framework used for building probabilistic models and performing Bayesian inference. It provides a probabilistic graphical model library for specifying random variables, priors, and likelihood functions, supported by an MCMC sampling engine and variational inference tools to estimate posterior distributions. The framework features a GPU-accelerated inference backend that compiles models into machine code to increase execution speed. It utilizes a backend-agnostic tensor execution model and just-in-time graph compilation to optimize the computation o
Estimates missing values within datasets using probabilistic frameworks to maintain uncertainty.
tsfresh is an automated feature engineering tool and library designed to extract statistical characteristics from raw time series data. It transforms sequential data into tabular datasets, converting time series into a flat format where each row represents a unique entity and columns represent extracted features. The project distinguishes itself through a parallel data processing framework that distributes heavy computational workloads across multiple CPU cores. It also implements hypothesis-based feature selection to identify the most predictive characteristics and filter out irrelevant ones
Fills gaps in extracted feature sets using specialized transformers to maintain compatibility with ML models.
This project is a Python financial analytics framework and quantitative trading library. It provides a suite of mathematical tools for asset pricing, statistical market analysis, and the development of algorithmic trading strategies. The library is distinguished by its focus on currency and commodity correlation modeling, using regression and normalization to identify exchange rate drivers. It features a specialized portfolio optimization engine that applies graph theory, such as clique centrality and degeneracy ordering, alongside quadratic programming to balance risk-adjusted returns. The
Fills gaps in pricing datasets by applying synthetic control methods based on similar economic entities.
Handles missing values natively in raw tabular input without requiring any preprocessing or imputation.
tsai is a deep learning library for time series classification, regression, and forecasting. Built on PyTorch and fastai, it provides a framework for assigning labels to sequential data, predicting future values in univariate or multivariate sequences, and training representations on unlabeled data through self-supervised learning. The library distinguishes itself with specialized temporal engineering and scaling capabilities. It includes tools for cyclical temporal encoding to capture seasonal patterns and online window slicing to process datasets larger than available memory. It also suppor
Fills gaps in sequential datasets using estimation techniques to ensure continuity for downstream modeling.
OSMnx este o bibliotecă Python pentru descărcarea, modelarea și analizarea rețelelor stradale și a altor caracteristici geospațiale din OpenStreetMap. Permite utilizatorilor să recupereze și să lucreze cu date de infrastructură din lumea reală oriunde în lume, oferind instrumente pentru analiza rețelei, interogări spațiale și vizualizare. Biblioteca oferă capabilități pentru lucrul cu caracteristici urbane, cum ar fi amprentele clădirilor, stațiile de tranzit și datele de elevație, împreună cu statistici de rețea precum densitatea intersecțiilor și circuitatea. Suportă mai multe moduri de călătorie, inclusiv condusul, mersul pe jos și mersul pe bicicletă, și poate calcula cele mai scurte căi, imputa vitezele de călătorie și genera hărți izoliniare. Funcționalitatea suplimentară include geocodarea, map-matching, proiecția coordonatelor și capacitatea de a salva și încărca rețele în diverse formate. OSMnx oferă instrumente pentru vizualizarea rețelelor stradale și a caracteristicilor geospațiale ca hărți statice sau hărți web interactive și poate plota diagrame figură-fond. Biblioteca este disponibilă prin metode standard de instalare a pachetelor Python.
Imputes missing travel speeds and calculates edge travel times for street network routing.
Acest proiect este o resursă educațională cuprinzătoare de machine learning și o serie de tutoriale livrate sub formă de colecție de Jupyter Notebooks interactive. Oferă implementări practice în Python pentru întregul ciclu de viață al machine learning-ului, acoperind învățarea supervizată și nesupervizată, deep learning și reinforcement learning. Resursa se remarcă prin ghiduri detaliate de implementare pentru arhitecturi complexe, inclusiv transformatoare, rețele generative adversariale (GAN) și rețele neuronale convoluționale. Include, de asemenea, cursuri specializate pentru dezvoltarea de agenți de reinforcement learning folosind Q-learning și Deep Q-Networks în medii simulate. Conținutul acoperă o gamă largă de capabilități în data science, inclusiv pipeline-uri de data engineering, codificarea trăsăturilor (feature encoding) și reducerea dimensionalității. Oferă materiale extinse despre evaluarea modelelor prin cross-validation și metrici de diagnostic, precum și subiecte avansate precum procesarea limbajului natural (NLP), analiza sentimentelor și AI generativ. Întregul curriculum este conceput pentru execuție interactivă în Jupyter Notebooks, combinând cod executabil, text bogat și vizualizări.
Provides methods for filling gaps in tabular datasets using scalar replacement or statistical propagation.
Acest proiect este o colecție cuprinzătoare de materiale educaționale de programare Python, incluzând tutoriale, exerciții și mostre de cod curate. Acesta servește drept curriculum de învățare și set de instrumente de inginerie software, utilizând Jupyter Notebooks pentru a combina codul executabil cu text educațional descriptiv. Repository-ul oferă ghiduri practice de implementare pentru construirea de aplicații cu modele de limbaj mari, cum ar fi sisteme de generare augmentată prin regăsire (RAG), agenți AI cu stare și fluxuri de lucru de machine learning. Se distinge prin oferirea unei abordări structurate a fluxurilor de lucru de codare agentică, acoperind distilarea ferestrei de context, rutarea modelelor agnostice la furnizor și output-uri structurate impuse prin schemă. Materialele acoperă o gamă largă de capabilități de inginerie software, inclusiv programarea asincronă cu cozi de sarcini distribuite, dezvoltarea de aplicații web cu API-uri REST și fluxuri de lucru de analiză a datelor. Include, de asemenea, resurse pentru stăpânirea designului orientat pe obiecte, implementarea pipeline-urilor CI/CD și aplicarea standardelor profesionale de linting și formatare.
Provides techniques for filling missing values in datasets using scalar replacement or propagation.
Vega-Lite is a high-level declarative language for specifying interactive, multi-view visualizations. It compiles a concise JSON specification into a full Vega visualization, automatically inferring scales, axes, and legends from encoding declarations. The grammar-of-graphics encoding maps data fields to visual channels such as position, color, size, and shape, while a multi-view composition grammar enables layered, faceted, concatenated, and repeated layouts. Reactive parameter binding links named parameters to input widgets, selections, and expressions for dynamic updates. The project suppo
Vega-Lite fills missing data values by generating new data points using a constant value or statistical methods within groups.
This is an interactive notebook-based course that teaches machine learning from Python fundamentals through deep learning and natural language processing. It uses real datasets and multiple frameworks within a structured, hands-on curriculum that combines concise explanations with executable code cells, built-in datasets, and embedded exercise checkpoints. Learning progresses through data preparation and exploration, classical machine learning workflows, computer vision with convolutional neural networks, and natural language processing with deep learning, all delivered as a cohesive progressi
Implements methods for detecting and filling gaps in datasets using scalar replacement and interpolation.
Connexion este un framework bazat pe specificații pentru construirea de API-uri care mapează automat specificațiile OpenAPI la logica aplicației. Utilizează aceste specificații pentru a automatiza rutarea, validarea cererilor și serializarea răspunsurilor, legând operațiunile API de funcțiile handler backend prin ID-uri de operațiune. Proiectul se diferențiază prin furnizarea unui server mock bazat pe schemă care simulează comportamentul API-ului folosind răspunsuri exemplu din specificație, fără a necesita logică backend. Include, de asemenea, un sistem de găzduire a documentației dinamice care traduce specificația API într-o consolă interactivă live pentru explorarea și testarea endpoint-urilor. Framework-ul acoperă domenii largi de capabilități, inclusiv aplicarea securității prin autentificare bazată pe middleware și validarea scope-ului, logică de validare pluggable pentru cereri și răspunsuri, și injectarea automată a parametrilor în argumentele funcțiilor tipizate. Oferă, de asemenea, utilitare pentru gestionarea ciclului de viață al aplicației, integrarea middleware-ului personalizat și simularea cererilor pentru testare. Proiectul poate fi utilizat pentru a bootstrap-a aplicații web standalone sau poate fi integrat în framework-uri existente pentru a adăuga capabilități bazate pe specificații.
Populates missing fields in incoming request bodies using default values specified in the API definition.
This project is a collection of comprehensive guides and reference materials designed for technical interviews, machine learning system design, and professional development. It serves as a technical knowledge base and a career coaching manual, providing structured resources to help candidates navigate the machine learning hiring landscape. The resource distinguishes itself by offering detailed frameworks for comparing industry roles, analyzing company types, and planning long-term career progression. It provides specific guidance on evaluating employer organizational health, identifying resea
Detects anomalous data points and decides whether to remove, cap, or transform them.