awesome-repositories.com
Blog
awesome-repositories.com

Entdecke die besten Open-Source-Repositories mit KI-gestützter Suche.

EntdeckenKuratierte SuchenOpen-Source-AlternativenSelf-hosted SoftwareBlogSitemap
ProjektÜber unsRanking-MethodikPresseMCP-Server
RechtlichesDatenschutzAGB
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·

121 Repos

Awesome GitHub RepositoriesGradient Computation

Tools for calculating function gradients to support model training and optimization.

Distinguishing note: Focuses on automatic differentiation for gradient calculation.

Explore 121 awesome GitHub repositories matching artificial intelligence & ml · Gradient Computation. Refine with filters or upvote what's useful.

Awesome Gradient Computation GitHub Repositories

Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
  • google-research/google-researchAvatar von google-research

    google-research/google-research

    38,139Auf GitHub ansehen↗

    This repository serves as a comprehensive research platform and toolkit for advancing machine learning, quantum computing, and large-scale scientific data analysis. It provides foundational frameworks for developing complex algorithmic systems, offering the necessary infrastructure for distributed training, computational graph execution, and high-performance model development. The project distinguishes itself by integrating specialized research domains with robust, privacy-preserving methodologies. It supports diverse scientific discovery through tools for quantum simulation, physics-informed

    Coordinates distributed parameter synchronization across compute nodes to enable large-scale parallel model training.

    Jupyter Notebookaimachine-learningresearch
    Auf GitHub ansehen↗38,139
  • exacity/deeplearningbook-chineseAvatar von exacity

    exacity/deeplearningbook-chinese

    37,285Auf GitHub ansehen↗

    This project is a comprehensive Chinese translation of a technical deep learning textbook, providing an educational resource on the theory and implementation of neural networks. It functions as a collaborative technical translation project designed to make complex academic AI literature accessible to non-English speakers. The project utilizes a community-driven translation model that integrates external suggestions and pull requests to refine linguistic accuracy and reduce bias. It employs standardized terminology mapping to ensure a uniform vocabulary throughout the translated content. To i

    Provides a technical explanation of computing gradients using backpropagation through time.

    TeX
    Auf GitHub ansehen↗37,285
  • google/jaxAvatar von google

    google/jax

    35,835Auf GitHub ansehen↗

    JAX is a hardware-accelerated array library and automatic differentiation system for numerical computing. It provides a framework compatible with NumPy that extends array operations with a just-in-time compiler to transform Python functions into optimized kernels for execution on GPU and TPU accelerators. The system differentiates itself through the use of an XLA-based compiler and a single program multiple data sharding model. These capabilities allow the library to distribute large-scale computations across multiple hardware accelerators using both automatic parallelization and manual shard

    Calculates function gradients using automatic differentiation to facilitate model optimization and training.

    Python
    Auf GitHub ansehen↗35,835
  • xingangpan/dragganAvatar von XingangPan

    XingangPan/DragGAN

    35,822Auf GitHub ansehen↗

    DragGAN is an interactive generative AI editor and GAN image editing tool designed for modifying the shape and structure of objects within images. It functions as a latent space manipulator that enables precise geometric and appearance editing by transforming images into editable latent codes. The system provides a web-based visual dashboard for real-time manipulation. Users can change the appearance of generated objects through an interactive point-based dragging interface, utilizing a process where source and target coordinates drive the optimization of the generative model. The project in

    Uses gradient-driven point tracking to precisely shift image pixels toward user-defined target locations.

    Pythonartificial-intelligencegenerative-adversarial-networkgenerative-models
    Auf GitHub ansehen↗35,822
  • jax-ml/jaxAvatar von jax-ml

    jax-ml/jax

    35,828Auf GitHub ansehen↗

    This project is a high-performance numerical computing library designed for large-scale scientific and machine learning workloads. It functions as an automatic differentiation framework and a just-in-time compilation engine, transforming high-level Python code into optimized machine instructions. By enforcing pure functional programming patterns and immutable array semantics, the library ensures that mathematical functions remain compatible with automated graph transformations and symbolic differentiation. The platform distinguishes itself through its distributed array computing capabilities,

    Calculates function gradients to support repeated differentiation for complex models.

    Pythonjax
    Auf GitHub ansehen↗35,828
  • d2l-ai/d2l-enAvatar von d2l-ai

    d2l-ai/d2l-en

    29,001Auf GitHub ansehen↗

    This project is an educational platform and research toolkit designed to teach deep learning through a combination of mathematical theory, visual diagrams, and executable code. It provides a comprehensive environment for building, training, and evaluating neural networks, grounding complex concepts in interactive computational notebooks that allow for hands-on experimentation. The framework distinguishes itself by interleaving theoretical foundations—including linear algebra, calculus, and probability—with practical implementations across multiple industry-standard libraries. It supports flex

    Provides automatic differentiation tools to calculate function gradients for model training and optimization.

    Pythonbookcomputer-visiondata-science
    Auf GitHub ansehen↗29,001
  • dmlc/xgboostAvatar von dmlc

    dmlc/xgboost

    28,471Auf GitHub ansehen↗

    XGBoost is a distributed machine learning library for implementing scalable gradient boosting decision trees used for regression, classification, and ranking. It functions as a predictive model framework and a cross-language toolkit, providing a core implementation with native bindings for Python, R, Java, Scala, and C++. The system is designed as a GPU-accelerated library that utilizes CUDA and NCCL to speed up the training of decision tree ensembles. It operates as a distributed framework capable of scaling training and prediction across multi-node clusters and GPU environments to process m

    Synchronizes gradients and model updates across compute nodes using a collective all-reduce communication pattern.

    C++distributed-systemsgbdtgbm
    Auf GitHub ansehen↗28,471
  • fastai/fastaiAvatar von fastai

    fastai/fastai

    27,862Auf GitHub ansehen↗

    Fastai is a high-level deep learning library built on PyTorch that provides a unified interface for managing the entire machine learning lifecycle. It functions as a comprehensive training toolkit, abstracting hardware management and automating complex training loops to simplify the construction and execution of neural network models. The framework is distinguished by its notebook-centric development environment and a type-dispatching data pipeline that automatically applies transformations based on input data formats. It emphasizes transfer learning through discriminative layer-wise optimiza

    Rescales gradient values during backpropagation to prevent training instability and model divergence.

    Jupyter Notebookcolabdeep-learningfastai
    Auf GitHub ansehen↗27,862
  • ml-explore/mlxAvatar von ml-explore

    ml-explore/mlx

    27,047Auf GitHub ansehen↗

    This project is a machine learning array framework and tensor computation library designed for high-performance numerical computing. It provides a comprehensive suite of tools for constructing and training neural networks, featuring an automatic differentiation engine that facilitates gradient-based optimization and complex mathematical modeling. The library distinguishes itself through a unified memory architecture that allows data to be shared across CPU and GPU devices without explicit copies, significantly reducing data movement overhead. Its execution model relies on a lazy evaluation en

    Computes derivatives of functions with respect to specific inputs or nested data structures, facilitating gradient-based optimization.

    C++mlx
    Auf GitHub ansehen↗27,047
  • fincept-corporation/finceptterminalAvatar von Fincept-Corporation

    Fincept-Corporation/FinceptTerminal

    26,900Auf GitHub ansehen↗

    FinceptTerminal is a quantitative finance platform and financial engineering library designed for asset valuation, risk management, and fixed-income analytics. It provides a comprehensive suite for algorithmic trading and investment strategy automation, integrating specialized language model agents and node-based workflows to automate market research and alpha generation. The project distinguishes itself with a dedicated game theory analysis engine for calculating Nash equilibria and simulating strategic interactions in competitive markets. It also features a specialized credit risk modeling

    Computes the gradient of a function to determine the rate of change for numerical analysis.

    C++bloomberg-terminalcontributions-welcomefinance
    Auf GitHub ansehen↗26,900
  • baidu/paddleAvatar von baidu

    baidu/paddle

    23,959Auf GitHub ansehen↗

    Paddle is a deep learning framework designed for building, training, and deploying large-scale machine learning models. It incorporates a distributed training engine for optimizing performance across multiple chips and a model inference engine for transforming trained models into production-ready formats for cross-platform execution. The platform features a heterogeneous hardware abstraction and a standardized software stack that allows models to run across diverse hardware architectures through a common interface. It also includes a scientific computing library capable of solving complex dif

    Implements dynamic computational graphs to support flexible model structures and automatic differentiation.

    C++
    Auf GitHub ansehen↗23,959
  • pyg-team/pytorch_geometricAvatar von pyg-team

    pyg-team/pytorch_geometric

    23,838Auf GitHub ansehen↗

    This project is a deep learning library designed for training neural networks on irregular data structures, including graphs, 3D meshes, and point clouds. It functions as an extension to the PyTorch framework, providing specialized layers and kernels that enable the processing of complex, non-Euclidean information. The library distinguishes itself through a geometric deep learning toolkit that manages the unique requirements of graph-based data. It utilizes sparse matrix-based message passing to aggregate information across nodes and employs dynamic computational graph construction to accommo

    Builds neural network execution paths on the fly to support irregular graph structures that change shape during training.

    Pythondeep-learninggeometric-deep-learninggraph-convolutional-networks
    Auf GitHub ansehen↗23,838
  • paddlepaddle/paddleAvatar von PaddlePaddle

    PaddlePaddle/Paddle

    23,632Auf GitHub ansehen↗

    Paddle is a deep learning framework designed for building, training, and deploying neural networks. It provides a platform for constructing models using tensor-based computations and supports both dynamic and static execution graphs to facilitate research and production workflows. The platform functions as a distributed machine learning system, enabling the scaling of training workloads across multiple nodes and hardware clusters. It includes a comprehensive toolkit for model deployment and optimization, allowing users to convert external model formats, compress trained models for resource-co

    Limits the size of weight updates during training to prevent numerical instability.

    C++deep-learningdistributed-trainingefficiency
    Auf GitHub ansehen↗23,632
  • accumulatemore/cvAvatar von AccumulateMore

    AccumulateMore/CV

    21,907Auf GitHub ansehen↗

    This project is a comprehensive deep learning framework and educational platform designed for constructing, training, and evaluating neural network architectures. It provides a modular environment for building models through tensor operations and automatic differentiation, supporting a wide range of tasks from image classification and object detection to sequential data processing. Beyond its core technical capabilities, the project distinguishes itself by integrating professional career development resources directly into its learning ecosystem. It offers structured guidance, resume reviews,

    Calculates partial derivatives of loss functions to automate parameter optimization.

    Jupyter Notebookagentagentsbook
    Auf GitHub ansehen↗21,907
  • zergtant/pytorch-handbookAvatar von zergtant

    zergtant/pytorch-handbook

    21,658Auf GitHub ansehen↗

    This project is a comprehensive educational resource and technical documentation suite for learning and developing deep learning models. It serves as an open-source textbook, implementation manual, and framework tutorial designed to guide users through the mathematical foundations and practical application of neural networks. The resource provides detailed instructional content on building various model architectures, including convolutional and recurrent neural networks. It includes a dedicated distributed training guide and a learning path that covers the fundamentals of tensors, automatic

    Teaches the use of dynamic graph builders to support flexible neural network architectures.

    Jupyter Notebookdeep-learningmachine-learningneural-network
    Auf GitHub ansehen↗21,658
  • apache/mxnetAvatar von apache

    apache/mxnet

    20,829Auf GitHub ansehen↗

    This project is a deep learning framework designed for constructing, training, and deploying neural networks across diverse hardware environments. It functions as a high-performance tensor computation library that provides both imperative and symbolic programming interfaces, allowing developers to balance flexible, step-by-step model building with the efficiency of compiled computation graphs. The framework distinguishes itself through a hybrid execution engine that integrates declarative graph compilation with imperative runtime logic. It supports scalable, distributed training across multip

    Coordinates gradient updates and weight synchronization across machines to maintain model consistency.

    C++mxnet
    Auf GitHub ansehen↗20,829
  • karpathy/nn-zero-to-heroAvatar von karpathy

    karpathy/nn-zero-to-hero

    20,351Auf GitHub ansehen↗

    This project is an educational resource and pedagogical framework designed to teach the fundamental mechanics of neural networks and gradient-based optimization. It provides a series of tutorials and code examples that guide users through building deep learning models from scratch, focusing on the implementation of core mathematical primitives and the underlying logic of backpropagation. The project distinguishes itself by providing a custom automatic differentiation engine that tracks mathematical operations in a dynamic computational graph. By implementing reverse-mode automatic differentia

    Calculates gradients automatically to facilitate efficient model optimization.

    Jupyter Notebook
    Auf GitHub ansehen↗20,351
  • lightgbm-org/lightgbmAvatar von lightgbm-org

    lightgbm-org/LightGBM

    18,460Auf GitHub ansehen↗

    LightGBM is a gradient boosting framework used to train decision tree ensembles for classification, regression, and ranking tasks. It functions as a distributed machine learning library and a decision tree ensemble implementation that utilizes leaf-wise growth and histogram-based feature binning. The framework is distinguished by its ability to offload heavy computations to CUDA or OpenCL devices for GPU acceleration and its capacity to parallelize training across multiple nodes using sockets, MPI, or Dask. It includes a specialized categorical feature processor that optimizes partitions for

    Implements gradient-based one-sided sampling to speed up training by prioritizing instances with large gradients.

    C++
    Auf GitHub ansehen↗18,460
  • microsoft/lightgbmAvatar von microsoft

    microsoft/LightGBM

    18,096Auf GitHub ansehen↗

    LightGBM is a high-performance machine learning framework designed for constructing gradient-boosted decision tree ensembles. It provides a platform for training classification, regression, and ranking models, with a focus on memory efficiency and large-scale distributed computing. The framework distinguishes itself through specialized algorithmic strategies, including leaf-wise tree growth and histogram-based decision learning, which prioritize convergence speed. It optimizes memory usage by bundling mutually exclusive features and employs gradient-based sampling to reduce training complexit

    Reduces training complexity by prioritizing instances with large gradients during the tree construction process.

    C++data-miningdecision-treesdistributed
    Auf GitHub ansehen↗18,096
  • mnielsen/neural-networks-and-deep-learningAvatar von mnielsen

    mnielsen/neural-networks-and-deep-learning

    17,721Auf GitHub ansehen↗

    This project is a comprehensive educational resource and curriculum designed to teach the mathematical foundations and practical implementation of neural networks. It provides a structured path for understanding how computers learn from data, covering core concepts such as gradient descent, backpropagation, and the biological inspiration behind artificial neurons. The platform distinguishes itself by combining theoretical proofs with hands-on implementation exercises. It demonstrates the universal approximation theorem through visual explanations and guides users in building various architect

    Calculates network gradients using backpropagation to determine weight and bias influence on error.

    Python
    Auf GitHub ansehen↗17,721
Vorherige123456…7Nächste
  1. Home
  2. Artificial Intelligence & ML
  3. Gradient Computation

Unter-Tags erkunden

  • Adjoint Gradient Calculation1 Sub-TagA memory-efficient method for calculating gradients by solving a second differential equation backwards in time. **Distinct from Gradient Computation:** Specifically uses the adjoint method for ODEs to avoid storing intermediate states, unlike general automatic differentiation.
  • Attribution Gradients1 Sub-TagComputes feature importance by backpropagating model outputs through the computational graph to input gradients. **Distinct from Gradient Computation:** Distinct from general Gradient Computation: focuses on gradients for attribution and interpretability, not for model training or optimization.
  • Backpropagation Through Time1 Sub-TagA specific gradient computation method for recurrent networks involving the unfolding of the graph. **Distinct from Gradient Computation:** Specific to the temporal unfolding process, distinct from general automatic differentiation.
  • Bitwise-Exact Gradient KernelsFused GPU kernels that produce gradients bitwise-identical to unfused implementations for drop-in replacement safety. **Distinct from Gradient Computation:** Distinct from Gradient Computation: guarantees bitwise-exact results compared to unfused operations, not just general gradient calculation.
  • Define-by-Run EnginesAutomatic differentiation engines that record computation history during forward execution for reverse-mode gradient computation. **Distinct from Gradient Computation:** Distinct from Gradient Computation: focuses on the define-by-run paradigm where the graph is built dynamically during execution, not just gradient calculation.
  • Distributed Gradient Synchronization2 Sub-TagsMechanisms for coordinating gradient updates across multiple compute nodes during distributed training. **Distinct from Gradient Computation:** Distinct from Gradient Computation: focuses on the synchronization of gradients across nodes rather than the differentiation process itself.
  • Dynamic Graph BuildersFrameworks that build computational graphs dynamically to support conditional logic and loops during gradient computation. **Distinct from Gradient Computation:** Distinct from general gradient computation: focuses on dynamic graph construction for control flow.
  • Gradient Aggregators4 Sub-TagsUtilities for reducing tensor outputs to scalar values for gradient computation. **Distinct from Gradient Computation:** Distinct from Gradient Computation: focuses specifically on the reduction step before differentiation, not the differentiation itself.
  • Gradient Analysis ToolsUtilities for identifying edges and gradients within visual data to extract structural information. **Distinct from Gradient Analysis Tools:** Focuses on computer vision gradient analysis for feature extraction, distinct from training-time gradient statistics.
  • Gradient Clipping UtilitiesRescales gradient values during backpropagation to prevent training divergence. **Distinct from Gradient Computation:** Focuses on gradient normalization for training stability, distinct from general automatic differentiation.
  • Gradient Norm Monitors2 Sub-TagsUtilities for calculating and tracking the norm of model gradients to ensure training stability. **Distinct from Gradient Computation:** Distinct from Gradient Clipping Utilities: focuses on the monitoring and calculation of norms for diagnostic purposes rather than active rescaling.
  • Gradient Truncation UtilitiesUtilities for terminating gradient sequences at varying time steps to provide unbiased estimates. **Distinct from Gradient Computation:** Distinct from general gradient computation: focuses on randomized sequence termination for efficiency.
  • Gradient Verification ToolsUtilities for comparing analytic gradients with numerical approximations to detect implementation bugs. **Distinct from Gradient Computation:** Focuses on verification and testing of gradients rather than the actual computation of gradients.
  • Gradient-Based Sampling4 Sub-TagsSampling strategies that prioritize instances with large gradients to reduce training complexity. **Distinct from Gradient Computation:** Distinct from gradient computation: focuses on data sampling strategies based on gradient magnitude, not the differentiation process itself.
  • Histogram of Oriented Gradients ExtractorsExtracts HOG features from an image for object detection or recognition. **Distinct from Gradient Computation:** Distinct from Gradient Computation: extracts HOG feature vectors for object detection, not for backpropagation or simulation.
  • Input Times Gradient Attribution MethodsMultiplies model inputs by the gradients of the model outputs with respect to those inputs to produce feature attributions. **Distinct from Gradient Computation:** Distinct from Gradient Computation: focuses on a specific attribution method using the product of inputs and gradients, not general gradient calculation.
  • Integrated Gradients Attribution MethodsApproximates the integral of gradients along a straight-line path from a baseline to the input to assign feature importance. **Distinct from Gradient Computation:** Distinct from Gradient Computation: focuses on a specific attribution method integrating gradients along a path, not general gradient calculation.
  • Normalization Gradient ComputationsCalculating gradients specifically for normalization layers during backpropagation. **Distinct from Gradient Computation:** Focuses on the gradients of normalization layers specifically, rather than general automatic differentiation.
  • Numerical Gradient ApproximationsEstimates function gradients using finite difference methods to verify analytic implementations. **Distinct from Gradient Computation:** Specifically covers numerical estimation via finite differences, distinct from automatic or analytic differentiation.
  • Point Tracking1 Sub-TagTechniques for tracking and shifting specific image pixels based on calculated gradients. **Distinct from Gradient Computation:** Distinct from general Gradient Computation: specifically applies gradients to pixel-level coordinate tracking for image deformation.
  • Sharpness-Aware MinimizationOptimization techniques that perturb weights to find flatter minima for improved generalization. **Distinct from Gradient Computation:** Specifies the SAM optimization method rather than general automatic differentiation or gradient calculation.
  • Simulation Gradient ComputationsComputation of gradients from physical simulation results to be used in machine learning frameworks. **Distinct from Gradient Computation:** Focuses on propagating gradients from simulation adjoint kernels back to ML models, rather than general automatic differentiation.
  • Textual BackpropagationThe process of flowing textual feedback from a loss function back through a computation graph to input text. **Distinct from Gradient Computation:** Specializes gradient computation for natural language feedback instead of numerical tensors.