Awesome GitHub RepositoriesSequence Padding Utilities

This project is an educational platform and research toolkit designed to teach deep learning through a combination of mathematical theory, visual diagrams, and executable code. It provides a comprehensive environment for building, training, and evaluating neural networks, grounding complex concepts in interactive computational notebooks that allow for hands-on experimentation. The framework distinguishes itself by interleaving theoretical foundations—including linear algebra, calculus, and probability—with practical implementations across multiple industry-standard libraries. It supports flex

This project is a high-performance library for converting raw text into tokens and IDs for machine learning models. It functions as a fast text encoder and a text preprocessing pipeline designed to transform strings into numerical representations with high throughput for research and production. The library includes a subword tokenizer trainer used to analyze text datasets and create custom vocabularies using algorithms such as byte-pair encoding and wordpiece. It provides capabilities for subword vocabulary training and text alignment, allowing character offsets to be tracked during normaliz

OpenRLHF is a training framework and alignment library designed for reinforcement learning from human feedback across distributed GPU clusters. It provides tools for aligning large language models and multimodal vision-language models using algorithms such as PPO, GRPO, and DPO. The framework distinguishes itself through a distributed inference engine that overlaps sample rollout with training to increase throughput. It supports scaling to models exceeding 70 billion parameters via parameter sharding and handles long-context sequences through ring-attention sequence parallelism. The project

This project is a comprehensive collection of educational examples and reference implementations for building vision and language models using PyTorch. It serves as a deep learning tutorial covering the end-to-end process of developing neural networks, from initial architecture definition to final production deployment. The repository provides detailed guides on implementing a wide range of domain-specific models, including convolutional neural networks for object detection and segmentation, as well as transformer and recurrent architectures for natural language processing. It emphasizes gene

This project is a collection of educational resources and instructional guides for learning deep learning and neural network implementation using TensorFlow. It provides a structured set of tutorials and notebooks written in Chinese, covering supervised and unsupervised learning tasks. The material focuses on practical implementations of diverse neural network architectures, including convolutional, recurrent, and autoencoder networks. It includes specific training content for computer vision, natural language processing, and generative models. The coverage extends to specialized network arc

ERNIE is a development toolkit for training, fine-tuning, and deploying large language models built on the PaddlePaddle deep learning platform. It provides a comprehensive suite of core components, including an inference server for vision and language models, a training and fine-tuning toolkit, and a framework for building retrieval-augmented generation systems using private knowledge bases. The project features multimodal AI models capable of reasoning across text, images, and video to perform complex visual understanding and information extraction. It distinguishes itself through specialize

tsai is a deep learning library for time series classification, regression, and forecasting. Built on PyTorch and fastai, it provides a framework for assigning labels to sequential data, predicting future values in univariate or multivariate sequences, and training representations on unlabeled data through self-supervised learning. The library distinguishes itself with specialized temporal engineering and scaling capabilities. It includes tools for cyclical temporal encoding to capture seasonal patterns and online window slicing to process datasets larger than available memory. It also suppor

Torchtune is a PyTorch-native library for fine-tuning, aligning, and quantizing large language models. It provides a config-driven system for instantiating components, orchestrating distributed training, and managing parameter-efficient fine-tuning with quantization support, all through YAML-based configurations and command-line overrides. The library distinguishes itself through its comprehensive post-training workflow orchestration, combining supervised fine-tuning, preference optimization (DPO, PPO, GRPO), knowledge distillation, and quantization-aware training in a single configurable pip

Torchtune is a PyTorch-native library for fine-tuning, aligning, and quantizing large language models. It provides a configurable training pipeline orchestrated through YAML recipes, with CLI overrides and component swapping, distributed training via FSDP2, memory optimizations, and parameter-efficient fine-tuning methods like LoRA, DoRA, and QLoRA. The library distinguishes itself through its YAML-driven configuration system that defines all training parameters and instantiates components from config files, with full CLI override capability for any field or component at launch time. It suppo

Acest proiect este un generator de poezie bazat pe deep learning, conceput pentru a crea cuplete tradiționale chinezești. Utilizează o arhitectură de rețea neuronală sequence-to-sequence pentru a mapa secvențele de text de intrare către secvențe de ieșire potrivite, funcționând ca un model de generare de text și un serviciu web de inferență. Sistemul dispune de un mecanism neuronal de ranking al textului care evaluează output-urile candidate pe baza consistenței lungimii și a tiparelor de caractere pentru a asigura alinierea structurală. Include, de asemenea, un proces de filtrare a conținutului care scanează textul generat împotriva listelor de cuvinte interzise pentru a elimina materialul sensibil sau inadecvat. Suprafața mai largă de capabilități include un pipeline de tokenizare a textului pentru pregătirea datelor și o interfață RESTful pentru servirea predicțiilor modelului prin JSON. Proiectul acoperă, de asemenea, ciclul de viață al machine learning-ului, cuprinzând optimizarea ponderilor modelului, antrenarea și evaluarea performanței față de seturile de date de validare.

This project provides a comprehensive technical guide and framework for engineering large-scale machine learning systems. It covers the full lifecycle of model development, focusing on the infrastructure and computational principles required to build, train, and serve generative AI models across distributed GPU clusters. The repository distinguishes itself by offering deep-dive tutorials and implementation strategies for complex system challenges. It emphasizes high-performance architectural primitives, such as collective communication orchestration, distributed tensor sharding, and static gr

EasyR1 este un sistem distribuit de antrenare a modelelor și un framework de învățare prin consolidare (reinforcement learning) pentru modele mari de limbaj și modele multimodale (text-imagine). Funcționează ca un antrenor multimodal și o implementare a unui pipeline de Proximal Policy Optimization, conceput pentru a rafina capacitățile de raționament și percepție ale modelelor care procesează atât text, cât și imagini. Sistemul se specializează în distribuirea sarcinilor de învățare prin consolidare pe mai multe noduri de calcul pentru a gestiona cerințele mari de memorie. Optimizează utilizarea hardware-ului prin antrenare fără padding și fine-tuning pentru a potrivi modele mari pe unitățile de procesare grafică (GPU) disponibile. Framework-ul acoperă învățarea prin consolidare și orchestrarea modelelor de recompensă, inclusiv fluxuri de lucru de învățare prin consolidare din feedback uman (RLHF). Suprafața sa tehnică include paralelismul distribuit al datelor, antrenarea cu precizie hibridă și pipeline-uri de intrare multimodale pentru date intercalate de text și imagine. Proiectul include utilitare pentru recuperarea stării bazată pe checkpoint-uri și se integrează cu instrumente externe de logare pentru urmărirea progresului antrenării și a metricilor de performanță.

This is an interactive notebook-based course that teaches machine learning from Python fundamentals through deep learning and natural language processing. It uses real datasets and multiple frameworks within a structured, hands-on curriculum that combines concise explanations with executable code cells, built-in datasets, and embedded exercise checkpoints. Learning progresses through data preparation and exploration, classical machine learning workflows, computer vision with convolutional neural networks, and natural language processing with deep learning, all delivered as a cohesive progressi

Acest proiect este un program educațional cuprinzător și un framework de deep learning conceput pentru a preda deep learning practic folosind PyTorch prin notebook-uri și exemple de cod. Servește drept bibliotecă de nivel înalt pentru construirea, antrenarea și implementarea rețelelor neuronale, acționând ca un orchestrator de antrenare a modelelor care coordonează modelele PyTorch, optimizatoarele și funcțiile de loss. Proiectul oferă toolkit-uri specializate pentru computer vision, procesarea limbajului natural și preprocesarea datelor tabelare. Se distinge prin controale avansate de antrenare, cum ar fi rate de învățare discriminative, un sistem de callback bidirecțional pentru personalizarea logicii de antrenare și o abstractizare de nivel înalt a learner-ului care automatizează plasarea pe dispozitiv și buclele de antrenare. Framework-ul acoperă o suprafață largă de capabilități, inclusiv construcția automată a pipeline-urilor de date, analiza arhitecturii modelelor și evaluarea performanței în sarcini de clasificare, regresie și segmentare. Include, de asemenea, utilitare pentru antrenarea distribuită pe mai multe GPU-uri, antrenarea cu precizie mixtă pentru optimizarea memoriei și suport specializat pentru date de imagistică medicală. Proiectul este livrat sub formă de serie de Jupyter Notebooks.

MoreLINQ is a functional programming toolkit and extension library for .NET that augments LINQ to Objects with advanced operators for sequence manipulation and analysis. It provides a set of tools for declarative data transformation, leveraging lazy evaluation and composition to handle complex object sequences. The library is distinguished by its specialized capabilities for combinatorial generation, including the production of permutations, subsets, and Cartesian products. It also provides advanced sequence joining options, such as full, left, and right outer joins, and supports complex data