awesome-repositories.com
Blog
awesome-repositories.com

Découvrez les meilleurs dépôts open-source grâce à notre recherche par IA.

ExplorerRecherches sélectionnéesAlternatives open sourceLogiciels auto-hébergésBlogPlan du site
ProjetÀ proposNotre méthodologiePresseServeur MCP
Mentions légalesConfidentialitéConditions d'utilisation
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·

83 dépôts

Awesome GitHub RepositoriesOptimization Algorithms

Mathematical methods for updating model parameters to minimize loss functions during training.

Distinguishing note: Focuses on the general mechanics of gradient-based parameter updates, distinct from specific model architectures.

Explore 83 awesome GitHub repositories matching artificial intelligence & ml · Optimization Algorithms. Refine with filters or upvote what's useful.

Awesome Optimization Algorithms GitHub Repositories

Trouvez les meilleurs dépôts grâce à l'IA.Nous recherchons les dépôts les plus pertinents grâce à l'IA.
  • jwasham/coding-interview-universityAvatar de jwasham

    jwasham/coding-interview-university

    353,639Voir sur GitHub↗

    Ce projet est une roadmap éducative complète conçue pour guider les ingénieurs logiciels à travers la maîtrise des fondamentaux de l'informatique et la préparation aux entretiens techniques. Il fournit un parcours d'apprentissage structuré et conscient des dépendances qui organise des concepts informatiques complexes dans un programme hiérarchique, permettant aux utilisateurs de construire une base d'ingénierie professionnelle grâce à une étude itérative et une mise en œuvre pratique. Le programme se distingue en intégrant les connaissances théoriques au développement professionnel, offrant un index unifié de ressources croisées, notamment des livres, des articles académiques et des tutoriels vidéo. Il met l'accent sur la standardisation de l'efficacité algorithmique par l'analyse de la complexité asymptotique et fournit une décomposition granulaire et modulaire des sujets pour faciliter un apprentissage ciblé et progressif à travers de vastes domaines techniques. Au-delà des algorithmes et des structures de données de base, le dépôt couvre une large surface de capacités, notamment la conception d'architecture système, les systèmes distribués, la sécurité informatique et la modélisation mathématique avancée. Il fournit également des conseils stratégiques pour l'ensemble du cycle de vie de l'embauche, de l'optimisation du CV et de la préparation aux entretiens comportementaux à la croissance de carrière à long terme. L'ensemble de la base de connaissances est maintenu en tant que dépôt contrôlé par version et piloté par markdown, permettant une approche agnostique de la plateforme et collaborative de l'éducation technique.

    Master the mathematical foundations of objective function optimization and constraint satisfaction essential for algorithmic problem solving.

    algorithmalgorithmscoding-interview
    Voir sur GitHub↗353,639
  • thealgorithms/pythonAvatar de TheAlgorithms

    TheAlgorithms/Python

    221,992Voir sur GitHub↗

    Ce projet est un dépôt complet d'implémentations computationnelles vérifiées conçu pour servir de ressource éducative pour l'informatique et la résolution de problèmes algorithmiques. Il fournit une collection structurée d'exemples de code qui couvrent les structures de données fondamentales, les opérations mathématiques et les concepts de programmation de base, permettant aux utilisateurs d'étudier la logique et la complexité derrière diverses méthodes computationnelles. Le dépôt se distingue par un modèle d'implémentation modulaire basé sur des références qui organise le code dans des espaces de noms logiques. Cette approche facilite l'exécution indépendante et la clarté éducative, permettant aux utilisateurs d'explorer l'évolution des stratégies computationnelles, des approches naïves par force brute aux solutions optimisées haute performance. En découplant les abstractions de structures de données des opérations algorithmiques, le projet garantit que les implémentations restent interchangeables et faciles à analyser. La surface de capacités couvre un large éventail de domaines techniques, notamment l'apprentissage automatique, la cryptographie, le calcul scientifique et la vision par ordinateur. Il inclut des implémentations pour la modélisation prédictive, les réseaux de neurones et l'analyse statistique, aux côtés d'outils pour le traitement du signal numérique, la gestion des flux réseau et la modélisation financière. La collection répond également à des besoins mathématiques spécialisés, tels que l'algèbre linéaire, les calculs géométriques et la manipulation de bits, fournissant une base large pour la recherche et les applications d'ingénierie.

    Resolve objective functions under linear constraints to determine the most efficient resource distribution.

    Pythonalgorithmalgorithm-competitionsalgorithms-implemented
    Voir sur GitHub↗221,992
  • developer-y/cs-video-coursesAvatar de Developer-Y

    Developer-Y/cs-video-courses

    81,816Voir sur GitHub↗

    This project is a community-driven educational repository that serves as a comprehensive directory of university-level computer science video lectures. It provides a structured learning path for students and professionals, aggregating high-quality academic resources to facilitate self-paced study across a wide range of technical disciplines. The repository distinguishes itself through a collaborative maintenance model, utilizing version control workflows to allow contributors to expand and update the collection. Content is organized within a single, version-controlled document that leverages

    Bundles academic resources that explain the mathematical methods used to optimize machine learning models.

    algorithmsbioinformaticscomputational-biology
    Voir sur GitHub↗81,816
  • d2l-ai/d2l-zhAvatar de d2l-ai

    d2l-ai/d2l-zh

    78,493Voir sur GitHub↗

    This project is an open-source, interactive educational platform designed to teach deep learning through a comprehensive, code-first curriculum. It provides a structured learning path that covers foundational mathematics, modern neural network architectures, and practical optimization techniques, enabling practitioners to master complex artificial intelligence concepts through hands-on experimentation. The platform distinguishes itself by integrating technical explanations with executable Jupyter notebooks. This design allows readers to modify code and hyperparameters in real-time, facilitati

    Details the iterative mechanics of updating model parameters by following negative gradients.

    Pythonbookchinesecomputer-vision
    Voir sur GitHub↗78,493
  • labmlai/annotated_deep_learning_paper_implementationsAvatar de labmlai

    labmlai/annotated_deep_learning_paper_implementations

    66,981Voir sur GitHub↗

    This project is a collection of deep learning research papers translated into annotated code. It serves as a resource for reproducing academic research, providing implementations of transformers, diffusion models, and reinforcement learning architectures. The library distinguishes itself by using a side-by-side annotation format that combines executable Python code with descriptive markdown notes. This approach provides a structured way to explain the logic of neural network papers alongside their PyTorch-based implementations. The codebase covers several major capability areas, including ge

    Implements various adaptive learning rate optimizers to improve model convergence speed and stability.

    Pythonattentiondeep-learningdeep-learning-tutorial
    Voir sur GitHub↗66,981
  • ultralytics/yolov5Avatar de ultralytics

    ultralytics/yolov5

    57,528Voir sur GitHub↗

    YOLOv5 is a comprehensive computer vision framework designed for end-to-end deep learning, specializing in real-time object detection, image classification, and instance segmentation. It provides a unified toolkit that manages the entire lifecycle of a model, from initial dataset configuration and hyperparameter tuning to high-speed inference and deployment. The framework utilizes a modular neural architecture, allowing users to swap backbone and head components to tailor models for specific visual tasks. What distinguishes this project is its focus on production-ready deployment and model ef

    Configures mathematical methods to adjust parameters and minimize loss functions during deep learning training.

    Pythoncoremldeep-learningios
    Voir sur GitHub↗57,528
  • exacity/deeplearningbook-chineseAvatar de exacity

    exacity/deeplearningbook-chinese

    37,285Voir sur GitHub↗

    This project is a comprehensive Chinese translation of a technical deep learning textbook, providing an educational resource on the theory and implementation of neural networks. It functions as a collaborative technical translation project designed to make complex academic AI literature accessible to non-English speakers. The project utilizes a community-driven translation model that integrates external suggestions and pull requests to refine linguistic accuracy and reduce bias. It employs standardized terminology mapping to ensure a uniform vocabulary throughout the translated content. To i

    Explains Adaptive Moment Estimation algorithms for gradient-based optimization.

    TeX
    Voir sur GitHub↗37,285
  • tinygrad/tinygradAvatar de tinygrad

    tinygrad/tinygrad

    33,147Voir sur GitHub↗

    Tinygrad is a deep learning framework and tensor computation engine designed for building and training neural networks. It functions as a hardware abstraction layer that manages device memory, command queues, and kernel dispatching across heterogeneous computing architectures. By utilizing a lazy-evaluation approach, the framework constructs computational graphs that defer execution until data is explicitly required, allowing it to process only the necessary operations for a given result. The project distinguishes itself through a just-in-time compilation layer that transforms abstract comput

    Updates model weights during training using gradient-based algorithms to improve performance.

    Python
    Voir sur GitHub↗33,147
  • eriklindernoren/ml-from-scratchAvatar de eriklindernoren

    eriklindernoren/ML-From-Scratch

    31,918Voir sur GitHub↗

    This project is an educational toolkit that provides implementations of fundamental machine learning algorithms built from scratch. By avoiding high-level library abstractions, it serves as a pedagogical reference for understanding the mathematical foundations and core mechanics of supervised learning, unsupervised learning, and reinforcement learning models. The repository distinguishes itself through a modular approach to model construction, allowing users to build custom neural networks by chaining independent functional blocks. It covers a wide range of techniques, including gradient-base

    Updates model parameters iteratively by calculating partial derivatives of the loss function.

    Pythondata-miningdata-sciencedeep-learning
    Voir sur GitHub↗31,918
  • ageron/handson-ml2Avatar de ageron

    ageron/handson-ml2

    29,938Voir sur GitHub↗

    This project provides a collection of practical machine learning code examples, including implementations for supervised, unsupervised, and reinforcement learning algorithms. It features deep learning model implementations for convolutional, recurrent, and generative architectures, alongside specific examples of reinforcement learning agents that maximize rewards in simulated environments. The repository includes dedicated data preprocessing pipelines for sanitization, feature scaling, and dimensionality reduction. It also provides implementations for a wide range of specific models, such as

    Includes examples comparing different gradient descent variants to analyze convergence rates during training.

    Jupyter Notebook
    Voir sur GitHub↗29,938
  • eugeneyan/applied-mlAvatar de eugeneyan

    eugeneyan/applied-ml

    29,783Voir sur GitHub↗

    This project is a comprehensive, curated knowledge base designed to support the development and maintenance of production-grade machine learning systems. It serves as a centralized repository of industry-standard technical literature, engineering case studies, and research papers, providing a structured reference for practitioners navigating the complexities of modern data science and machine learning engineering. The resource distinguishes itself through a cross-domain approach that bridges the gap between academic research and practical implementation. By synthesizing proven industry archit

    Improve the efficiency and effectiveness of algorithms or processes by fine-tuning parameters to achieve better results with fewer resources.

    applied-data-scienceapplied-machine-learningcomputer-vision
    Voir sur GitHub↗29,783
  • d2l-ai/d2l-enAvatar de d2l-ai

    d2l-ai/d2l-en

    29,001Voir sur GitHub↗

    This project is an educational platform and research toolkit designed to teach deep learning through a combination of mathematical theory, visual diagrams, and executable code. It provides a comprehensive environment for building, training, and evaluating neural networks, grounding complex concepts in interactive computational notebooks that allow for hands-on experimentation. The framework distinguishes itself by interleaving theoretical foundations—including linear algebra, calculus, and probability—with practical implementations across multiple industry-standard libraries. It supports flex

    Provides standard optimization algorithms like minibatch stochastic gradient descent to update model parameters during training.

    Pythonbookcomputer-visiondata-science
    Voir sur GitHub↗29,001
  • fastai/fastaiAvatar de fastai

    fastai/fastai

    27,862Voir sur GitHub↗

    Fastai is a high-level deep learning library built on PyTorch that provides a unified interface for managing the entire machine learning lifecycle. It functions as a comprehensive training toolkit, abstracting hardware management and automating complex training loops to simplify the construction and execution of neural network models. The framework is distinguished by its notebook-centric development environment and a type-dispatching data pipeline that automatically applies transformations based on input data formats. It emphasizes transfer learning through discriminative layer-wise optimiza

    Provides a suite of adaptive learning rate algorithms including Adam, RAdam, and LAMB to accelerate convergence.

    Jupyter Notebookcolabdeep-learningfastai
    Voir sur GitHub↗27,862
  • ageron/handson-mlAvatar de ageron

    ageron/handson-ml

    25,608Voir sur GitHub↗

    This is a machine learning educational repository consisting of a collection of notebooks and code examples. It provides practical implementations of diverse machine learning algorithms and workflows, ranging from traditional scientific computing to deep learning. The project features specific implementations of Scikit-Learn models, such as decision trees, random forests, and support vector machines, as well as TensorFlow examples for building neural networks, convolutional layers, and recurrent architectures. It also includes tutorials on reinforcement learning development and the creation o

    Demonstrates vectorized gradient descent using matrix operations to efficiently update model weights.

    Jupyter Notebook
    Voir sur GitHub↗25,608
  • trekhleb/homemade-machine-learningAvatar de trekhleb

    trekhleb/homemade-machine-learning

    24,608Voir sur GitHub↗

    This project provides a collection of machine learning algorithms implemented from scratch in Python. It serves as an educational resource using interactive notebooks that combine code with mathematical explanations to demonstrate the first principles of data science. The repository includes reference implementations for neural networks, such as multilayer perceptrons with backpropagation, and supervised learning models including linear and logistic regression. It also covers unsupervised learning through k-means clustering and Gaussian anomaly detection. The codebase covers a broad range of

    Implements gradient descent as the primary iterative optimization method for minimizing cost functions.

    Jupyter Notebook
    Voir sur GitHub↗24,608
  • fastai/fastbookAvatar de fastai

    fastai/fastbook

    24,587Voir sur GitHub↗

    This project is an interactive educational textbook and comprehensive machine learning resource designed for deep learning education. It provides a structured curriculum that combines narrative prose with executable code, utilizing literate programming to create reproducible learning experiences within a collection of Jupyter Notebooks. The repository distinguishes itself by teaching machine learning through applied research and modular design. It demonstrates a callback-driven training loop, a declarative data-block pipeline, and a layered abstraction API that allows users to transition betw

    Explains and demonstrates accelerated stochastic gradient descent techniques.

    Jupyter Notebookbookdata-sciencedeep-learning
    Voir sur GitHub↗24,587
  • karpathy/mingptAvatar de karpathy

    karpathy/minGPT

    23,639Voir sur GitHub↗

    minGPT is a minimal implementation of the Transformer architecture designed for training and experimenting with language models. It functions as a neural network training framework and a text generation engine, providing the necessary tools to manage data loading, backpropagation, and parameter updates for custom deep learning models. The project is structured as an educational resource for understanding how transformer architectures function by building and training models from scratch. It utilizes a modular block architecture and transformer-based self-attention to process sequences, allowi

    Provides gradient-based parameter update methods for training neural network models.

    Python
    Voir sur GitHub↗23,639
  • shusentang/dive-into-dl-pytorchAvatar de ShusenTang

    ShusenTang/Dive-into-DL-PyTorch

    19,409Voir sur GitHub↗

    This project is a deep learning curriculum and a collection of PyTorch tutorials designed for deep learning education. It provides a structured set of technical documents and runnable notebooks that translate theoretical machine learning concepts into executable code. The repository includes implementation guides for various neural network architectures, specifically covering convolutional, recurrent, and transformer-based models. It provides practical examples for building computer vision pipelines for object detection and semantic segmentation, as well as natural language processing tools f

    Implements training algorithms using gradient-based optimizers like SGD, Adam, and RMSProp.

    Jupyter Notebook
    Voir sur GitHub↗19,409
  • jcjohnson/neural-styleAvatar de jcjohnson

    jcjohnson/neural-style

    18,288Voir sur GitHub↗

    This is a PyTorch implementation of a neural style transfer system. It functions as a convolutional neural network image stylizer and artistic style blender designed to combine the content of one image with the artistic style of another. The system supports blending multiple style sources and adjusting the relative weights between content and style reconstruction. It includes capabilities for preserving the original color palette of the content image and adjusting style scales to determine which artistic patterns are transferred. The pipeline enables high-resolution image processing by distr

    Employs iterative gradient descent to refine the output image by minimizing the content and style loss functions.

    Lua
    Voir sur GitHub↗18,288
  • nlp-love/ml-nlpAvatar de NLP-LOVE

    NLP-LOVE/ML-NLP

    17,725Voir sur GitHub↗

    This project is a machine learning algorithm reference and implementation guide that provides theoretical foundations and code for supervised learning, deep learning, and natural language processing. It serves as a comprehensive toolkit for implementing predictive models and a technical reference for algorithm engineering. The project focuses on ensemble learning frameworks, including the construction of decision trees, random forests, and gradient boosting models. It also functions as a probabilistic graphical model library and an NLP algorithm reference, with specific implementations for se

    Implements gradient descent and Newton algorithms to minimize log loss and optimize model parameters.

    Jupyter Notebookdeep-learningmachine-learningnlp
    Voir sur GitHub↗17,725
Préc.1234…5Suivant
  1. Home
  2. Artificial Intelligence & ML
  3. Optimization Algorithms

Explorer les sous-tags

  • AdaGrad OptimizersAdaptive gradient descent algorithms that adjust learning rates based on parameter frequency.
  • Adam Optimizers1 sous-tagAdaptive Moment Estimation algorithms for gradient-based optimization of stochastic objective functions.
  • Adaptive Learning Rate Optimizers4 sous-tagsOptimization algorithms that adjust learning rates based on parameter updates.
  • Adaptive OptimizersAdvanced gradient descent algorithms that adjust learning rates dynamically. **Distinct from Adam Optimizers:** Covers a suite of optimizers including Adam, RMSprop, and Momentum, not just Adam
  • Gradient Ascent AlgorithmsIterative optimization algorithms that move in the direction of the gradient to maximize a function. **Distinct from Gradient Descent Algorithms:** Implements gradient ascent for maximization, whereas the sibling focuses on gradient descent for minimization.
  • Gradient Descent Algorithms4 sous-tagsIterative optimization algorithms that update model parameters by moving in the direction of the negative gradient.
  • Gradient-Free Optimization LibrariesToolkits providing algorithms for function optimization that do not require gradient information. **Distinct from Gradient Descent Algorithms:** Contrasts with gradient-descent algorithms by specifically avoiding the use of derivatives.
  • High-Performance Optimizer Implementations1 sous-tagOptimized versions of standard optimizers designed to reduce synchronization and memory bottlenecks. **Distinct from Adam Optimizers:** Focuses on the performance implementation of optimizers rather than the mathematical algorithm itself
  • Hyperparameter Optimizers2 sous-tagsTools for automated search, tuning, and pruning of neural network configurations to improve efficiency. **Distinct from Neural Network Optimizers:** Focuses on structural hyperparameter tuning and pruning rather than gradient-based weight updates
  • Linear ProgrammingAlgorithms used to optimize objective functions by solving problems subject to specific linear constraints.
  • Neural Network Optimizers2 sous-tagsAlgorithms for updating model parameters using gradient information, such as SGD, Adam, and RMSProp. **Distinct from Adam Optimizers:** Distinct from Adam Optimizers: covers the general category of gradient-based optimizers for neural networks rather than a single algorithm.
  • SMO AlgorithmsSpecific optimization routines that solve quadratic programming problems for support vector machines. **Distinct from Optimization Algorithms:** Specializes general optimization algorithms to the Sequential Minimal Optimization technique for SVMs.