Awesome GitHub RepositoriesRegularization Techniques

Transformers is a comprehensive library for machine learning that provides a unified interface for training, fine-tuning, and deploying transformer-based models. It supports a wide range of tasks, including text classification, language modeling, question answering, and sequence-to-sequence translation, while offering specialized architectures for both text and vision processing. The framework includes tools for managing the entire model lifecycle, from data preprocessing and tokenization to distributed training and inference. The library features extensive support for model optimization and

This project is an open-source, interactive educational platform designed to teach deep learning through a comprehensive, code-first curriculum. It provides a structured learning path that covers foundational mathematics, modern neural network architectures, and practical optimization techniques, enabling practitioners to master complex artificial intelligence concepts through hands-on experimentation. The platform distinguishes itself by integrating technical explanations with executable Jupyter notebooks. This design allows readers to modify code and hyperparameters in real-time, facilitati

This project is an educational platform and research toolkit designed to teach deep learning through a combination of mathematical theory, visual diagrams, and executable code. It provides a comprehensive environment for building, training, and evaluating neural networks, grounding complex concepts in interactive computational notebooks that allow for hands-on experimentation. The framework distinguishes itself by interleaving theoretical foundations—including linear algebra, calculus, and probability—with practical implementations across multiple industry-standard libraries. It supports flex

Fastai is a high-level deep learning library built on PyTorch that provides a unified interface for managing the entire machine learning lifecycle. It functions as a comprehensive training toolkit, abstracting hardware management and automating complex training loops to simplify the construction and execution of neural network models. The framework is distinguished by its notebook-centric development environment and a type-dispatching data pipeline that automatically applies transformations based on input data formats. It emphasizes transfer learning through discriminative layer-wise optimiza

This project provides a collection of machine learning algorithms implemented from scratch in Python. It serves as an educational resource using interactive notebooks that combine code with mathematical explanations to demonstrate the first principles of data science. The repository includes reference implementations for neural networks, such as multilayer perceptrons with backpropagation, and supervised learning models including linear and logistic regression. It also covers unsupervised learning through k-means clustering and Gaussian anomaly detection. The codebase covers a broad range of

This repository is an educational collection of deep learning implementations designed to demonstrate the fundamental principles of neural network architecture and optimization. It provides a comprehensive resource for understanding machine learning through hands-on code examples, ranging from basic multilayer perceptrons to complex generative models. The project distinguishes itself by emphasizing the manual construction of models, including the implementation of backpropagation from scratch to illustrate core mathematical mechanics. It covers a wide array of architectural design patterns, s

DINOv2 is a self-supervised vision transformer foundation model designed to generate high-quality visual representations from raw image data. By leveraging large-scale unlabelled datasets, the framework learns to extract robust numerical embeddings that serve as inputs for various machine learning and analysis workflows. The model distinguishes itself through a teacher-student training framework that utilizes centered and sharpened soft probability distributions to align feature maps across multiple image crops. It incorporates a masking strategy that forces the model to reconstruct missing i

This repository collects illustrated single-page cheat sheets that compress the core topics of Stanford's CS 230 deep learning course into visual reference summaries. The collection covers convolutional neural networks, recurrent neural networks, and practical training techniques, pairing schematic diagrams with mathematical notation to bridge intuition and formal understanding. The cheat sheets are organized by subject area and link related concepts across topics, such as connecting vanishing gradients to LSTM gates, to reinforce the full deep learning workflow. Practical training advice on

PyTorch Metric Learning is an open-source library for training neural networks to produce similarity-preserving embedding spaces. It provides a modular framework where interchangeable loss functions, mining strategies, and evaluation tools can be composed to learn representations that map similar items to nearby points and dissimilar items to distant points in the embedding space. The library distinguishes itself through a highly configurable architecture that separates concerns across several interchangeable components. Users can assemble custom loss functions from pluggable distance metrics

GluonTS este un framework pentru prognoza probabilistică a seriilor temporale, conceput pentru a prezice valori viitoare ca distribuții de probabilitate cu intervale de încredere. Suportă atât antrenarea modelelor tradiționale, cât și prognoza zero-shot, unde modelele preantrenate generează predicții pentru serii noi fără antrenare suplimentară. Proiectul se distinge prin integrarea unei mari varietăți de abordări de prognoză într-un flux de lucru unificat. Aceasta include arhitecturi de deep learning precum rețelele neuronale recurente și convoluțiile cauzale, precum și integrarea modelelor statistice externe, a bibliotecii Prophet și a pachetelor R. Toolkit-ul oferă o suprafață cuprinzătoare pentru ingineria datelor de serii temporale, acoperind scalarea seturilor de date, divizarea și transformarea datelor temporale brute în tensori. Include, de asemenea, o suită de instrumente de evaluare pentru măsurarea acurateței prognozei și a intervalelor de incertitudine, precum și utilitare pentru persistența seturilor de date folosind formate precum Arrow și Parquet. Framework-ul suportă implementarea modelelor de prognoză în cadrul infrastructurii cloud.

GluonTS este o bibliotecă de serii temporale probabilistice și un framework de prognoză prin deep learning. Oferă un toolkit pentru construirea, antrenarea și evaluarea arhitecturilor de rețele neuronale care prezic valori viitoare ca distribuții de probabilitate pentru a cuantifica incertitudinea. Proiectul se distinge prin suportul pentru prognoza zero-shot și integrarea unor abordări de modelare diverse, incluzând rețele neuronale probabilistice profunde și wrapper-e pentru biblioteci statistice externe precum Prophet și R forecast. Implementează primitive arhitecturale specializate precum convoluțiile cauzale și rețelele reziduale inversabile pentru a preveni scurgerea informațiilor și a mapa reprezentările latente în distribuții de probabilitate valide. Framework-ul acoperă o suprafață cuprinzătoare de inginerie a datelor, incluzând scalarea seriilor temporale, transformări bijective și modelare ierarhică. Utilizează Apache Arrow și Parquet pentru streaming-ul seturilor de date de înaltă performanță și gestionarea accesului aleatoriu. Pentru evaluarea modelului, include o suită de evaluare pentru măsurarea acurateței prognozei și a acoperirii probabilistice folosind metrici precum quantile loss și continuous rank probability scores. Biblioteca suportă implementarea modelului prin integrarea cu Amazon SageMaker.

This project is a collection of comprehensive guides and reference materials designed for technical interviews, machine learning system design, and professional development. It serves as a technical knowledge base and a career coaching manual, providing structured resources to help candidates navigate the machine learning hiring landscape. The resource distinguishes itself by offering detailed frameworks for comparing industry roles, analyzing company types, and planning long-term career progression. It provides specific guidance on evaluating employer organizational health, identifying resea

Acest proiect este o bibliotecă cuprinzătoare pentru transfer learning și adaptarea domeniului în computer vision. Acesta servește drept framework pentru alinierea distribuțiilor de caracteristici între seturile de date sursă și țintă, un set de instrumente pentru generalizarea domeniului și o bibliotecă pentru învățare semi-supervizată folosind seturi mici de date etichetate și seturi mari neetichetate. Biblioteca oferă capabilități specializate pentru adaptarea nesupervizată a domeniului, inclusiv utilizarea rețelelor adversariale, arhitecturi bazate pe discrepanță și traducerea imagine-la-imagine pentru a reduce nepotrivirea distribuției. Include, de asemenea, instrumente pentru generalizarea domeniului pentru a asigura fiabilitatea modelului pe domenii țintă nevăzute prin style-mixing și minimizarea riscului invariant. Proiectul acoperă o suprafață largă de capabilități, inclusiv adaptarea sarcinilor și fine-tuning-ul cu regularizare specializată, antrenarea semi-supervizată prin pseudo-etichetare și învățarea consistenței, precum și selecția modelelor de transfer learning folosind metrici de transferabilitate. Include, de asemenea, un manager de seturi de date pentru automatizarea achiziției și pregătirii benchmark-urilor de viziune standardizate. Biblioteca include utilitare pentru monitorizare și observabilitate, cum ar fi vizualizări t-SNE și metrici A-distance pentru a analiza distribuțiile caracteristicilor și discrepanța domeniului.

This project is a computer vision pipeline and volumetric rendering system used to transform photos and videos into high-fidelity 3D models. It implements a deformable neural radiance field framework that optimizes deformation fields to represent non-rigid moving subjects in three dimensions. The system utilizes volumetric deformation fields to map 3D coordinates from a static canonical space to a deformed state. This allows for the reconstruction of photorealistic scenes and the synthesis of high-fidelity images from camera perspectives not present in the original input data. The framework

DeepLearnToolbox is a research-oriented framework for constructing, training, and optimizing hierarchical neural networks within the Matlab and Octave environments. It provides a modular set of tools for building diverse network topologies, including feedforward, convolutional, and deep belief architectures, using native matrix-based numerical computation. The library distinguishes itself through its support for layer-wise unsupervised pre-training, which establishes initial weights for deep models before supervised fine-tuning. It incorporates stochastic gradient descent and backpropagation

This project is a machine learning educational archive and technical documentation collection. It serves as a deep learning tutorial series and implementation guide, providing theoretical explanations and practical walkthroughs for constructing and optimizing neural networks. The content focuses on the design and construction of diverse model architectures, including convolutional neural networks, Long Short-Term Memory networks, and generative adversarial networks. It details specific implementation patterns for autoencoders, sentiment analysis models, and various classification approaches.