6 dépôts
Frameworks for filtering, cleaning, and modifying data nodes before they are used in downstream processing or model generation.
Distinguishing note: Focuses on the transformation logic applied to retrieved data nodes, distinct from general data ETL processes.
Explore 6 awesome GitHub repositories matching artificial intelligence & ml · Data Transformation Pipelines. Refine with filters or upvote what's useful.
LlamaIndex is a comprehensive development framework designed to connect private or external data sources to large language models. It functions as a data-centric toolkit that enables the construction of retrieval-augmented generation systems, allowing developers to build applications that provide context-aware answers based on specific organizational information. The project distinguishes itself through a robust agentic orchestration engine that supports the creation of autonomous agents capable of multi-step reasoning, memory management, and complex tool execution. Beyond simple retrieval, i
LlamaIndex defines specialized logic for filtering or transforming data nodes by implementing custom processing classes that modify information before it reaches the final response generation stage.
This is a machine learning educational repository consisting of a collection of notebooks and code examples. It provides practical implementations of diverse machine learning algorithms and workflows, ranging from traditional scientific computing to deep learning. The project features specific implementations of Scikit-Learn models, such as decision trees, random forests, and support vector machines, as well as TensorFlow examples for building neural networks, convolutional layers, and recurrent architectures. It also includes tutorials on reinforcement learning development and the creation o
Sequences data cleaning, scaling, and encoding into reusable pipelines to prevent data leakage.
This project is a deep learning library designed for training neural networks on irregular data structures, including graphs, 3D meshes, and point clouds. It functions as an extension to the PyTorch framework, providing specialized layers and kernels that enable the processing of complex, non-Euclidean information. The library distinguishes itself through a geometric deep learning toolkit that manages the unique requirements of graph-based data. It utilizes sparse matrix-based message passing to aggregate information across nodes and employs dynamic computational graph construction to accommo
Applies modular preprocessing steps to raw graph inputs through a functional interface that standardizes data formats for neural network consumption.
This project is a comprehensive deep learning framework and educational platform designed for constructing, training, and evaluating neural network architectures. It provides a modular environment for building models through tensor operations and automatic differentiation, supporting a wide range of tasks from image classification and object detection to sequential data processing. Beyond its core technical capabilities, the project distinguishes itself by integrating professional career development resources directly into its learning ecosystem. It offers structured guidance, resume reviews,
Automates data loading, augmentation, and batching pipelines for model training.
The AWS Cloud Development Kit is an infrastructure-as-code framework that enables developers to define and provision cloud resources using familiar programming languages. By utilizing construct-based synthesis, it translates high-level, object-oriented code into declarative templates, allowing for the automated management of complex cloud environments through a centralized, code-driven control plane. The framework distinguishes itself through its ability to model infrastructure as a dependency-aware resource graph, ensuring that components are provisioned and updated in the correct order. It
Executes custom code during data requests to dynamically process, filter, or modify objects before they are returned to the application.
Ce dépôt est une collection d'implémentations de référence, de templates et de galeries d'exemples pour construire et intégrer des modèles de machine learning au sein de l'écosystème .NET. Il fournit un ensemble de démonstrations pratiques pour implémenter des workflows de machine learning en utilisant le framework ML.NET. Le projet met l'accent sur l'intégration de modèles pré-entraînés via le format Open Neural Network Exchange, permettant l'exécution de logique de machine learning externe au sein d'applications managées. Il inclut des exemples spécifiques pour charger et exécuter ces modèles standardisés afin d'assurer la compatibilité multiplateforme. Les exemples couvrent une gamme de tâches d'apprentissage supervisé, incluant la classification de sentiment textuel, l'analyse d'images et de vidéos pour la détection d'objets, et la prévision de séries temporelles. Il fournit également des implémentations pour la détection d'anomalies réseau et des outils pour l'optimisation d'hyperparamètres et les pipelines de transformation de données.
Implements frameworks for filtering, cleaning, and modifying data before it is used in model generation.