83 个仓库
Mathematical methods for updating model parameters to minimize loss functions during training.
Distinguishing note: Focuses on the general mechanics of gradient-based parameter updates, distinct from specific model architectures.
Explore 83 awesome GitHub repositories matching artificial intelligence & ml · Optimization Algorithms. Refine with filters or upvote what's useful.
这是一个全面的教育路线图,旨在指导软件工程师掌握计算机科学基础知识并准备技术面试。它提供了一条结构化的、具备依赖感知能力的学习路径,将复杂的计算概念组织成层级化课程,使用户能够通过迭代学习和实践实现,构建专业的工程基础。 该课程将理论知识与职业发展相结合,提供了一个包含书籍、学术论文和视频教程的交叉引用资源索引。它强调通过渐进复杂度分析实现算法效率的标准化,并提供细粒度的模块化主题分解,以促进跨广阔技术领域的专注、增量学习。 除了核心算法和数据结构外,该仓库还涵盖了广泛的能力领域,包括系统架构设计、分布式系统、计算机安全和高级数学建模。它还为整个招聘生命周期提供战略指导,从简历优化和行为面试准备到长期职业成长。 整个知识库作为版本控制的 Markdown 驱动仓库进行维护,允许以平台无关和协作的方式进行技术教育。
Master the mathematical foundations of objective function optimization and constraint satisfaction essential for algorithmic problem solving.
该项目是一个经过验证的计算实现综合仓库,旨在作为计算机科学和算法问题解决的教育资源。它提供了一个结构化的代码示例集合,涵盖了基本数据结构、数学运算和核心编程概念,允许用户研究各种计算方法背后的逻辑和复杂度。 该仓库通过模块化的、基于参考的实现模式脱颖而出,将代码组织成逻辑命名空间。这种方法促进了独立执行和教育清晰度,使用户能够探索计算策略从朴素的暴力破解方法到优化的、高性能解决方案的演变。通过将数据结构抽象与算法操作解耦,该项目确保了实现保持可互换且易于分析。 能力领域涵盖了广泛的技术领域,包括机器学习、密码学、科学计算和计算机视觉。它包括用于预测建模、神经网络和统计分析的实现,以及用于数字信号处理、网络流管理和金融建模的工具。该集合还解决了专门的数学需求,如线性代数、几何计算和位操作,为研究和工程应用提供了广泛的基础。
Resolve objective functions under linear constraints to determine the most efficient resource distribution.
This project is a community-driven educational repository that serves as a comprehensive directory of university-level computer science video lectures. It provides a structured learning path for students and professionals, aggregating high-quality academic resources to facilitate self-paced study across a wide range of technical disciplines. The repository distinguishes itself through a collaborative maintenance model, utilizing version control workflows to allow contributors to expand and update the collection. Content is organized within a single, version-controlled document that leverages
Bundles academic resources that explain the mathematical methods used to optimize machine learning models.
This project is an open-source, interactive educational platform designed to teach deep learning through a comprehensive, code-first curriculum. It provides a structured learning path that covers foundational mathematics, modern neural network architectures, and practical optimization techniques, enabling practitioners to master complex artificial intelligence concepts through hands-on experimentation. The platform distinguishes itself by integrating technical explanations with executable Jupyter notebooks. This design allows readers to modify code and hyperparameters in real-time, facilitati
Details the iterative mechanics of updating model parameters by following negative gradients.
This project is a collection of deep learning research papers translated into annotated code. It serves as a resource for reproducing academic research, providing implementations of transformers, diffusion models, and reinforcement learning architectures. The library distinguishes itself by using a side-by-side annotation format that combines executable Python code with descriptive markdown notes. This approach provides a structured way to explain the logic of neural network papers alongside their PyTorch-based implementations. The codebase covers several major capability areas, including ge
Implements various adaptive learning rate optimizers to improve model convergence speed and stability.
YOLOv5 is a comprehensive computer vision framework designed for end-to-end deep learning, specializing in real-time object detection, image classification, and instance segmentation. It provides a unified toolkit that manages the entire lifecycle of a model, from initial dataset configuration and hyperparameter tuning to high-speed inference and deployment. The framework utilizes a modular neural architecture, allowing users to swap backbone and head components to tailor models for specific visual tasks. What distinguishes this project is its focus on production-ready deployment and model ef
Configures mathematical methods to adjust parameters and minimize loss functions during deep learning training.
This project is a comprehensive Chinese translation of a technical deep learning textbook, providing an educational resource on the theory and implementation of neural networks. It functions as a collaborative technical translation project designed to make complex academic AI literature accessible to non-English speakers. The project utilizes a community-driven translation model that integrates external suggestions and pull requests to refine linguistic accuracy and reduce bias. It employs standardized terminology mapping to ensure a uniform vocabulary throughout the translated content. To i
Explains Adaptive Moment Estimation algorithms for gradient-based optimization.
Tinygrad is a deep learning framework and tensor computation engine designed for building and training neural networks. It functions as a hardware abstraction layer that manages device memory, command queues, and kernel dispatching across heterogeneous computing architectures. By utilizing a lazy-evaluation approach, the framework constructs computational graphs that defer execution until data is explicitly required, allowing it to process only the necessary operations for a given result. The project distinguishes itself through a just-in-time compilation layer that transforms abstract comput
Updates model weights during training using gradient-based algorithms to improve performance.
This project is an educational toolkit that provides implementations of fundamental machine learning algorithms built from scratch. By avoiding high-level library abstractions, it serves as a pedagogical reference for understanding the mathematical foundations and core mechanics of supervised learning, unsupervised learning, and reinforcement learning models. The repository distinguishes itself through a modular approach to model construction, allowing users to build custom neural networks by chaining independent functional blocks. It covers a wide range of techniques, including gradient-base
Updates model parameters iteratively by calculating partial derivatives of the loss function.
This project provides a collection of practical machine learning code examples, including implementations for supervised, unsupervised, and reinforcement learning algorithms. It features deep learning model implementations for convolutional, recurrent, and generative architectures, alongside specific examples of reinforcement learning agents that maximize rewards in simulated environments. The repository includes dedicated data preprocessing pipelines for sanitization, feature scaling, and dimensionality reduction. It also provides implementations for a wide range of specific models, such as
Includes examples comparing different gradient descent variants to analyze convergence rates during training.
This project is a comprehensive, curated knowledge base designed to support the development and maintenance of production-grade machine learning systems. It serves as a centralized repository of industry-standard technical literature, engineering case studies, and research papers, providing a structured reference for practitioners navigating the complexities of modern data science and machine learning engineering. The resource distinguishes itself through a cross-domain approach that bridges the gap between academic research and practical implementation. By synthesizing proven industry archit
Improve the efficiency and effectiveness of algorithms or processes by fine-tuning parameters to achieve better results with fewer resources.
This project is an educational platform and research toolkit designed to teach deep learning through a combination of mathematical theory, visual diagrams, and executable code. It provides a comprehensive environment for building, training, and evaluating neural networks, grounding complex concepts in interactive computational notebooks that allow for hands-on experimentation. The framework distinguishes itself by interleaving theoretical foundations—including linear algebra, calculus, and probability—with practical implementations across multiple industry-standard libraries. It supports flex
Provides standard optimization algorithms like minibatch stochastic gradient descent to update model parameters during training.
Fastai is a high-level deep learning library built on PyTorch that provides a unified interface for managing the entire machine learning lifecycle. It functions as a comprehensive training toolkit, abstracting hardware management and automating complex training loops to simplify the construction and execution of neural network models. The framework is distinguished by its notebook-centric development environment and a type-dispatching data pipeline that automatically applies transformations based on input data formats. It emphasizes transfer learning through discriminative layer-wise optimiza
Provides a suite of adaptive learning rate algorithms including Adam, RAdam, and LAMB to accelerate convergence.
This is a machine learning educational repository consisting of a collection of notebooks and code examples. It provides practical implementations of diverse machine learning algorithms and workflows, ranging from traditional scientific computing to deep learning. The project features specific implementations of Scikit-Learn models, such as decision trees, random forests, and support vector machines, as well as TensorFlow examples for building neural networks, convolutional layers, and recurrent architectures. It also includes tutorials on reinforcement learning development and the creation o
Demonstrates vectorized gradient descent using matrix operations to efficiently update model weights.
This project provides a collection of machine learning algorithms implemented from scratch in Python. It serves as an educational resource using interactive notebooks that combine code with mathematical explanations to demonstrate the first principles of data science. The repository includes reference implementations for neural networks, such as multilayer perceptrons with backpropagation, and supervised learning models including linear and logistic regression. It also covers unsupervised learning through k-means clustering and Gaussian anomaly detection. The codebase covers a broad range of
Implements gradient descent as the primary iterative optimization method for minimizing cost functions.
This project is an interactive educational textbook and comprehensive machine learning resource designed for deep learning education. It provides a structured curriculum that combines narrative prose with executable code, utilizing literate programming to create reproducible learning experiences within a collection of Jupyter Notebooks. The repository distinguishes itself by teaching machine learning through applied research and modular design. It demonstrates a callback-driven training loop, a declarative data-block pipeline, and a layered abstraction API that allows users to transition betw
Explains and demonstrates accelerated stochastic gradient descent techniques.
minGPT is a minimal implementation of the Transformer architecture designed for training and experimenting with language models. It functions as a neural network training framework and a text generation engine, providing the necessary tools to manage data loading, backpropagation, and parameter updates for custom deep learning models. The project is structured as an educational resource for understanding how transformer architectures function by building and training models from scratch. It utilizes a modular block architecture and transformer-based self-attention to process sequences, allowi
Provides gradient-based parameter update methods for training neural network models.
This project is a deep learning curriculum and a collection of PyTorch tutorials designed for deep learning education. It provides a structured set of technical documents and runnable notebooks that translate theoretical machine learning concepts into executable code. The repository includes implementation guides for various neural network architectures, specifically covering convolutional, recurrent, and transformer-based models. It provides practical examples for building computer vision pipelines for object detection and semantic segmentation, as well as natural language processing tools f
Implements training algorithms using gradient-based optimizers like SGD, Adam, and RMSProp.
This is a PyTorch implementation of a neural style transfer system. It functions as a convolutional neural network image stylizer and artistic style blender designed to combine the content of one image with the artistic style of another. The system supports blending multiple style sources and adjusting the relative weights between content and style reconstruction. It includes capabilities for preserving the original color palette of the content image and adjusting style scales to determine which artistic patterns are transferred. The pipeline enables high-resolution image processing by distr
Employs iterative gradient descent to refine the output image by minimizing the content and style loss functions.
This project is a machine learning algorithm reference and implementation guide that provides theoretical foundations and code for supervised learning, deep learning, and natural language processing. It serves as a comprehensive toolkit for implementing predictive models and a technical reference for algorithm engineering. The project focuses on ensemble learning frameworks, including the construction of decision trees, random forests, and gradient boosting models. It also functions as a probabilistic graphical model library and an NLP algorithm reference, with specific implementations for se
Implements gradient descent and Newton algorithms to minimize log loss and optimize model parameters.