4 dépôts
Techniques to reduce computational overhead and parameters within neural network layers.
Distinct from Deep Learning Optimization: Focuses on reducing layer-level parameter count and overhead rather than general computational graph optimization
Explore 4 awesome GitHub repositories matching artificial intelligence & ml · Layer Parameter Optimization. Refine with filters or upvote what's useful.
MLAlgorithms is an educational machine learning algorithm library consisting of core predictive models implemented from scratch in Python. It serves as a reference for developers to study the internal logic and mathematical workings of these models through clean, minimal implementations. The codebase focuses on the study of algorithm implementation and machine learning education, providing a way to understand internal mechanics by building components without relying on heavy external libraries. The project utilizes object-oriented encapsulation and NumPy-based vectorization to manage model s
Provides modular weight initialization strategies separated from the training loop to allow for various randomization techniques.
This repository contains programming assignments and lecture notes from Andrew Ng's foundational deep learning course specialization on Coursera. The materials cover core neural network training techniques including optimization algorithms, normalization methods, regularization approaches, parameter initialization strategies, and learning rate scheduling to improve model convergence and generalization. The coursework explores design principles where successive neural network layers learn progressively more abstract feature representations from input data. It provides guidance on selecting ope
Randomly initialize weight matrices and bias vectors for each layer based on layer dimensions.
Swift for TensorFlow is a custom toolchain that extends the Swift language with first-class automatic differentiation and differentiable types, enabling gradient-based computation directly within the compiler. It integrates the Swift compiler with TensorFlow runtime and XLA backends, allowing tensor operations to be compiled and executed on hardware-accelerated hardware for high-performance machine learning. The project distinguishes itself through compiler-integrated automatic differentiation that computes gradients of user-defined functions and types during compilation, eliminating the need
Traverses nested parameter structures to apply optimizers for complex model architectures.
PlugNPlay-Modules is a collection of reusable PyTorch computer vision modules and deep learning architectural components. It provides a library of standardized building blocks for constructing neural networks, focusing on attention mechanisms, signal processing layers, and feature fusion modules. The project is distinguished by its extensive variety of attention primitives, covering spatial, channel, and temporal weighting, as well as specialized variants like deformable, frequency-enhanced, and linear-complexity attention. It also implements advanced signal processing tools within the neural
Implements computational efficiency improvements through separable and partial convolutions and stochastic depth.