Awesome GitHub RepositoriesModel Training Pipelines

ChatGLM-6B is a generative AI inference engine designed for local execution of transformer-based language models. It provides a comprehensive runtime environment that allows users to load and run pre-trained neural network weights directly on their own hardware, ensuring data privacy and independence from external cloud services. The project distinguishes itself through a hardware-agnostic execution backend that supports deployment across diverse environments, including standard processors, Apple Silicon, and multi-GPU configurations. It incorporates advanced optimization techniques such as w

Awesome-quant is a curated directory of open-source software libraries and tools designed for quantitative finance, algorithmic trading, and financial data analysis. It serves as a central hub for discovering resources that support the entire lifecycle of financial modeling, from raw data ingestion to complex statistical research. The repository organizes specialized tools into categorized collections, enabling users to identify solutions for high-performance numerical computing, technical indicator calculation, and derivative pricing. It highlights frameworks that facilitate the construction

Audiocraft is a deep learning audio library and machine learning framework designed for training, fine-tuning, and evaluating generative models for music and sound effects. It functions as a text-to-music generative model and a neural audio codec, providing the tools necessary to compress audio signals into discrete representations and synthesize high-fidelity waveforms from textual descriptions. The framework is distinguished by its ability to combine multiple conditioning signals, allowing for the generation of audio based on text prompts, melodic excerpts, or style-based audio clips. It al

Recommenders is a recommendation system framework designed for building, benchmarking, and deploying collaborative and content-based filtering models. It provides a machine learning model pipeline that standardizes the process of moving recommendation data from raw ingestion through training and evaluation. The project functions as a model benchmarking toolkit, utilizing standardized ranking and error metrics to compare the accuracy of different algorithms. It also serves as a hyperparameter tuning tool, allowing for the optimization of model behavior and performance via external configuratio

Seaborn is a Python library designed for statistical data visualization. It functions as a high-level interface built on the Matplotlib ecosystem, providing specialized routines to explore and communicate complex patterns within datasets. The framework enables users to generate informative graphics through automated statistical aggregation, multi-plot faceting, and integrated regression modeling. The library distinguishes itself through a declarative approach to data mapping, which translates raw inputs into visual properties like color, size, and position. It includes a robust statistical tr

TPOT is a Python automated machine learning tool and pipeline framework. It automatically searches, selects, and tunes machine learning algorithms and hyperparameters to identify the most effective model architecture. The system utilizes genetic programming to optimize these pipelines through evolutionary algorithms. To accelerate the search process, it functions as a multi-core evaluator that runs parallel training workflows across multiple processor cores. The framework supports the definition of custom objective functions to optimize pipelines based on specific performance metrics.

PyCaret is a Python AutoML platform and MLOps lifecycle manager designed to automate machine learning workflows. It functions as a low-code environment that leverages a scikit-learn native engine to execute preprocessing, training, and evaluation for tabular data. The platform distinguishes itself as an LLM-powered ML copilot, using large language model agents to analyze datasets, design experiment configurations, and explain model results. It also serves as a Kubernetes ML orchestrator and model registry, enabling the versioning of trained pipelines and their promotion to production API endp

MMPose is a PyTorch-based pose estimation toolbox and deep learning training pipeline designed for detecting 2D and 3D keypoints on humans, animals, and faces. It serves as a computer vision model zoo and a framework for both 2D pose estimation and 3D pose lifting. The project is distinguished by its modular architecture and extensibility, employing a registry-based system and hierarchical configurations to allow for custom algorithm integration and model pipeline customization. It supports diverse estimation paradigms, including top-down, bottom-up, and two-stage pose lifting workflows. The

ggplot2 is a data visualization library for R based on a formal grammar of graphics. It provides a declarative plotting framework that allows users to create complex graphics by combining geometric objects, statistical summaries, and coordinate systems. The system is distinguished by a layered approach to composition, where visualizations are built incrementally by stacking independent geometric, statistical, and coordinate layers. It utilizes a hierarchical styling engine to manage non-data elements such as backgrounds, fonts, and margins, and includes a multi-panel faceting tool for splitti

Vega-Lite is a high-level declarative language for specifying interactive, multi-view visualizations. It compiles a concise JSON specification into a full Vega visualization, automatically inferring scales, axes, and legends from encoding declarations. The grammar-of-graphics encoding maps data fields to visual channels such as position, color, size, and shape, while a multi-view composition grammar enables layered, faceted, concatenated, and repeated layouts. Reactive parameter binding links named parameters to input widgets, selections, and expressions for dynamic updates. The project suppo

OpenPrompt ist ein Prompt-Learning-Framework, das darauf ausgelegt ist, Large Language Models an nachgelagerte NLP-Aufgaben anzupassen. Es bietet ein umfassendes Toolkit zur Implementierung von manuellen, Soft- und kontinuierlichen Prompting-Strategien, wodurch Modelle verfeinert werden können, ohne alle zugrunde liegenden Parameter aktualisieren zu müssen. Das Projekt zeichnet sich durch die Unterstützung von diskretem und kontinuierlichem Prompt-Tuning aus. Es enthält ein System zum Injizieren trainierbarer Soft-Tokens und Embeddings in Modelleingaben mittels Gradientenabstieg sowie eine automatische Prompt-Generierungs-Engine, die Beam-Search und generative Modelle verwendet, um hochwahrscheinliche Text-Templates für spezifische Datensätze zu finden. Das Framework deckt mehrere Kernbereiche ab, darunter Template-Design und Label-Verbalisierung zur Zuordnung von Klassifizierungs-Labels zu Vokabelwörtern. Es bietet zudem Modell-Anpassungstools zum Umhüllen vortrainierter Modelle, Logit-Kalibrierung zur Verbesserung der Vorhersagegenauigkeit sowie eine Daten-Pipeline mit spezialisierter Sampling-Logik für Few-Shot-Learning. Trainings- und Experiment-Workflows werden über Konfigurationsdateien verwaltet, die Lernszenarien, Hyperparameter und Pipeline-Spezifikationen definieren.

Plotnine ist eine Datenvisualisierungsbibliothek für Python, die auf der Grammar of Graphics basiert. Sie dient als deklaratives statistisches Plotting-Framework und Multi-Panel-Plotting-Engine, die es Benutzern ermöglicht, komplexe Diagramme durch das Mapping von Datenvariablen auf visuelle Eigenschaften wie Position, Farbe und Größe zu erstellen. Das Projekt zeichnet sich durch sein schichtbasiertes Kompositionsmodell und eine statistische Transformations-Engine aus, die Aggregationen und Berechnungen vor dem Rendern der Visualisierungen durchführt. Es verfügt über ein umfassendes System für Multi-Panel-Faceting, das die Aufteilung einer einzelnen Visualisierung in ein Raster von Sub-Plots basierend auf kategorialen Variablen ermöglicht. Die Bibliothek deckt ein breites Spektrum an Funktionen ab, einschließlich diverser geometrischer Repräsentationen für Verteilungs-, Flächen- und Streudiagramme sowie Geodaten-Visualisierung für das Rendern geografischer Grenzen. Sie bietet umfangreiche Tools für Skalen-Mapping, Koordinatenprojektionen und themenbasiertes Styling, um datengetriebene Elemente von nicht-datenbezogenen ästhetischen Eigenschaften zu trennen. Das Framework nutzt ein Matplotlib-Backend für das Rendering und integriert sich über Piping-Operationen mit tabellarischen Dataframes.

AdalFlow is an autonomous AI agent framework and LLM application library designed for building modular workflows. It serves as a model-agnostic interface and RAG pipeline orchestrator, allowing users to develop ReAct agents that utilize iterative reasoning and external tool execution to solve complex tasks. The project distinguishes itself through a prompt optimization system that uses textual gradient descent to automatically refine prompt templates and few-shot examples. It treats model feedback as a differentiable signal, enabling a form of LLM backpropagation to iteratively improve output

Fengshenbang-LM is a Chinese language model ecosystem and pre-training framework designed for the development and fine-tuning of billion-parameter large language models. It serves as a natural language processing pipeline and cross-modal AI platform capable of generating content across different modalities, including text-to-image generation and protein structure prediction. The project provides a domain-specific model adapter for applying pretrained models to specialized industries such as healthcare, finance, and law. It utilizes a distributed configuration system and data sharding to manag

PaddleRec ist eine Deep-Learning-Empfehlungsbibliothek und ein Framework für verteiltes Modelltraining auf Basis des PaddlePaddle-Frameworks. Es bietet eine Suite industrieller Algorithmen und Modelle für das User-Matching und das personalisierte Content-Ranking. Das Projekt enthält eine Empfehlungs-Inferenz-Engine für den Export und die Bereitstellung trainierter Modelle in Produktionsumgebungen für Online-Echtzeitanfragen. Es ermöglicht die Implementierung von Deep-Learning-Empfehlungsalgorithmen zur Verarbeitung massiver Verhaltensdatensätze. Das Framework deckt das Modelltraining im großen Maßstab über verteilte Rechencluster hinweg ab sowie die Entwicklung von Systemen zum Ranking von Elementen basierend auf persönlichen Präferenzen.

Stable-audio-tools is a toolkit for training and deploying latent diffusion models for high-fidelity audio synthesis. It provides a framework for generating audio by iteratively refining noise within a compressed latent space, using specialized encoders to preserve temporal and spectral features of the audio signal. The project features a system for adapting pre-trained audio checkpoints to new datasets through modular initialization and configuration files. It includes utilities for weight extraction and inference model export, which remove training metadata and optimizer states to create li

This is a structured deep learning curriculum for programmers, delivered as a collection of Jupyter notebooks. It teaches the fundamentals of training neural networks for computer vision, natural language processing, tabular data analysis, and collaborative filtering using PyTorch and the fastai library. The course is designed to be hands-on, guiding learners from building a training loop from scratch to fine-tuning pretrained models for a variety of practical tasks. The curriculum distinguishes itself by covering the full lifecycle of a deep learning project, from data preparation and augmen

This project is a technical resource and implementation guide for building transformer-based language model architectures and training pipelines from scratch. It focuses on the design of models capable of natural language processing, including the integration of pretrained weights and the creation of foundational model frameworks. The project specifically emphasizes logical reasoning and mathematical problem solving. It provides a framework for optimizing these capabilities through reinforcement learning and the use of automated verifiers to evaluate and reward correct reasoning paths. The r

TotalSegmentator is a medical image segmentation tool and AI-driven organ segmenter designed to isolate anatomical structures from CT scans. It functions as a deep learning anatomy parser and quantitative radiomics analyzer, providing a framework for identifying diverse body tissues and bones to create precise anatomical masks. The system distinguishes itself through a comprehensive medical analysis suite that includes patient biometric estimation for demographics such as age, sex, weight, and height. It further provides specialized clinical index calculations and modality and phase classific

Neural collaborative filtering is a recommendation system framework that predicts user item preferences from implicit feedback by combining generalized matrix factorization and multi-layer perceptron networks through a shared final embedding layer. It captures both linear and non-linear interactions to model user preferences from historical data. The framework executes training and evaluation runs through a configuration-driven pipeline accessible via command-line interfaces, parsing hyperparameters such as learning rates, batch sizes, and latent dimensions. It optimizes implicit feedback mod