1 Repo
Awesome GitHub RepositoriesNormalization Gradient Computations
Calculating gradients specifically for normalization layers during backpropagation.
Distinct from Gradient Computation: Focuses on the gradients of normalization layers specifically, rather than general automatic differentiation.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Normalization Gradient Computations. Refine with filters or upvote what's useful.
Awesome Normalization Gradient Computations GitHub Repositories
Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
- xlite-dev/leetcuda
xlite-dev/LeetCUDA
9,694Auf GitHub ansehenLeetCUDA is a collection of high-performance GPU kernel libraries focusing on memory optimization, activation functions, and attention mechanisms. It serves as a reference library for CUDA kernel implementations, ranging from basic element-wise operations to complex neural network components, and provides Python bindings to integrate these kernels into deep learning workflows. The project is distinguished by its focus on low-level hardware optimizations. This includes the use of tensor cores for half-precision matrix multiplication, asynchronous data pipelining with double buffering, and shar
Computes vector-jacobian products for weights and biases in layer normalization using parallel reduction.
Cudacudacuda-12cuda-cpp
