awesome-repositories.com
博客
awesome-repositories.com

通过 AI 驱动的搜索,发现最优秀的开源仓库。

探索精选搜索开源替代品自托管软件博客网站地图
项目关于排名机制媒体报道MCP 服务器
法律隐私政策服务条款
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·

6 个仓库

Awesome GitHub RepositoriesData Processing Pipelines

Frameworks for standardizing the transformation, augmentation, and loading of data for machine learning models.

Distinguishing note: Focuses on ML-specific data preparation workflows rather than general ETL or database operations.

Explore 6 awesome GitHub repositories matching artificial intelligence & ml · Data Processing Pipelines. Refine with filters or upvote what's useful.

Awesome Data Processing Pipelines GitHub Repositories

用 AI 发现最棒的仓库。我们将通过 AI 为您搜索最匹配的仓库。
  • fengdu78/lihang-codefengdu78 的头像

    fengdu78/lihang-code

    19,548在 GitHub 上查看↗

    This repository is a collection of foundational machine learning models and predictive analysis tools designed for the study of statistical learning methods. It serves as an educational resource that demonstrates the mathematical principles of classic algorithms through direct, first-principles implementation. The project distinguishes itself by constructing models from the ground up, relying on fundamental linear algebra and calculus operations rather than high-level abstraction frameworks. Each algorithm is organized into modular, standalone scripts that mirror the sequence of mathematical

    Executes sequential data transformation pipelines to process inputs through iterative mathematical operations.

    Jupyter Notebook
    在 GitHub 上查看↗19,548
  • camel-ai/camelcamel-ai 的头像

    camel-ai/camel

    17,253在 GitHub 上查看↗

    This project is a comprehensive framework for building and managing autonomous agent systems. It provides a unified architecture for orchestrating multi-agent societies, where specialized agents collaborate through roleplay to decompose and solve complex tasks. The system integrates language models with external environments, enabling agents to perform real-world actions through a standardized tool-calling abstraction layer. The framework distinguishes itself through its focus on iterative reasoning and data reliability. It employs automated feedback loops to refine agent outputs and self-eva

    Defines configurable pipelines for transforming and preparing data specifically for multi-agent system training and evaluation.

    Pythonagentai-societiesartificial-intelligence
    在 GitHub 上查看↗17,253
  • ai4finance-foundation/finrlAI4Finance-Foundation 的头像

    AI4Finance-Foundation/FinRL

    13,964在 GitHub 上查看↗

    FinRL is a reinforcement learning framework designed for the development, training, and backtesting of automated trading strategies. It functions as a quantitative finance toolkit that integrates deep learning algorithms with financial market simulations to address complex portfolio management and asset allocation tasks. The platform provides an end-to-end pipeline for transforming raw market data into actionable trading models. The project distinguishes itself through a layered, modular architecture that separates data processing, environment simulation, and agent training. This design allow

    Automates the ingestion, cleaning, and feature engineering of financial time-series data into structured inputs for machine learning models.

    Jupyter Notebookalgorithmic-tradingdeep-reinforcement-learningdrl-algorithms
    在 GitHub 上查看↗13,964
  • rasbt/python-machine-learning-bookrasbt 的头像

    rasbt/python-machine-learning-book

    12,614在 GitHub 上查看↗

    This project is an educational resource providing practical code examples and implementations of machine learning algorithms using the Python language. It serves as a guide for constructing predictive pipelines, clustering models, and dimensionality reduction within the Scikit-Learn ecosystem. The repository includes comprehensive demonstrations for supervised and unsupervised learning, as well as detailed examples for implementing neural networks and deep architectures. It also provides practical guidance on exporting model parameters to JSON and wrapping trained models in web APIs for produ

    Constructs comprehensive data processing pipelines for transforming and cleaning raw data for ML models.

    Jupyter Notebook
    在 GitHub 上查看↗12,614
  • open-mmlab/mmagicopen-mmlab 的头像

    open-mmlab/mmagic

    7,434在 GitHub 上查看↗

    mmagic is a multimodal training pipeline and framework for generative AI, focusing on visual synthesis and restoration. It provides the infrastructure to build and train models for tasks such as text-to-image and text-to-video generation, 3D-aware content synthesis, and high-fidelity image translation using diffusion models and generative adversarial networks. The project distinguishes itself through specialized capabilities for generative model personalization, including techniques for fine-tuning subjects and styles. It also supports advanced visual manipulations such as latent space interp

    Provides composable data processing pipelines for loading, rescaling, and augmenting multimodal assets for machine learning.

    Jupyter Notebookaigccomputer-visiondeep-learning
    在 GitHub 上查看↗7,434
  • fafa-dl/awesome-backbonesFafa-DL 的头像

    Fafa-DL/Awesome-Backbones

    1,945在 GitHub 上查看↗

    Awesome-Backbones is a modular deep learning framework designed for the end-to-end lifecycle of computer vision models. It provides an integrated platform for training, benchmarking, and deploying convolutional and transformer-based neural network architectures for image classification tasks. The framework distinguishes itself through a configuration-driven approach to model assembly, allowing users to define backbone, neck, and head components externally. It includes a specialized toolkit for model interpretability, utilizing gradient-based visualization techniques to generate class activati

    Constructs automated pipelines for image loading, normalization, and augmentation to prepare data for training.

    Pythoncnndeep-learningimage-classification
    在 GitHub 上查看↗1,945
  1. Home
  2. Artificial Intelligence & ML
  3. Data Processing Pipelines