# wangshusen/deeplearning

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/wangshusen-deeplearning).**

4,226 stars · 889 forks · TeX · NOASSERTION

## Links

- GitHub: https://github.com/wangshusen/DeepLearning
- awesome-repositories: https://awesome-repositories.com/repository/wangshusen-deeplearning.md

## Description

This is an educational repository providing implementations and tutorials for deep learning, neural network architectures, and machine learning fundamentals. It serves as a reference for building multilayer perceptrons, convolutional networks, and recurrent networks using backpropagation and gradient descent.

The project includes specialized frameworks for generative modeling via autoencoders and generative adversarial networks, as well as a toolkit for reinforcement learning that implements value-based, policy-based, and actor-critic methods. It also provides practical references for transformer and BERT architectures, focusing on attention mechanisms for natural language processing and visual data tasks.

The repository covers a broad range of capabilities, including computer vision processing, sequence modeling, and adversarial robustness analysis. It also provides guides for distributed machine learning, detailing strategies for scaling training across multiple nodes using MapReduce, parameter servers, and federated learning.

The project provides foundational support for traditional machine learning algorithms, specifically covering regression, classification, and clustering.

## Tags

### Artificial Intelligence & ML

- [Neural Network Construction](https://awesome-repositories.com/f/artificial-intelligence-ml/neural-network-construction.md) — Provides a comprehensive guide and implementations for designing and building deep learning architectures like MLPs and CNNs.
- [Convolutional Feature Extraction](https://awesome-repositories.com/f/artificial-intelligence-ml/convolutional-feature-extraction.md) — Implements convolutional filters and pooling layers to extract spatial hierarchies of visual patterns from images.
- [Deep Reinforcement Learning Implementations](https://awesome-repositories.com/f/artificial-intelligence-ml/deep-q-learning-implementations/deep-reinforcement-learning-implementations.md) — Implements advanced reinforcement learning algorithms including value-based, policy-based, and actor-critic methods. ([source](https://github.com/wangshusen/deeplearning#readme))
- [Generative Models](https://awesome-repositories.com/f/artificial-intelligence-ml/generative-models.md) — Implements generative architectures such as autoencoders and generative adversarial networks for synthetic data and image generation. ([source](https://github.com/wangshusen/deeplearning#readme))
- [Machine Learning Implementations](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning-implementations.md) — Provides code-based implementations of foundational machine learning algorithms including regression, classification, and clustering. ([source](https://github.com/wangshusen/deeplearning#readme))
- [Computer Vision](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning/frameworks/computer-vision.md) — Implements convolutional neural networks and normalization techniques for image pattern analysis and processing. ([source](https://github.com/wangshusen/deeplearning#readme))
- [Neural Network Implementation Guides](https://awesome-repositories.com/f/artificial-intelligence-ml/neural-network-implementation-guides.md) — Offers practical guides for translating mathematical neural network concepts into code implementations from scratch.
- [Sequential Data Models](https://awesome-repositories.com/f/artificial-intelligence-ml/sequential-data-models.md) — Uses recurrent neural networks and transformer architectures to process natural language and generate text sequences. ([source](https://github.com/wangshusen/deeplearning#readme))
- [Transformer Architecture Implementation](https://awesome-repositories.com/f/artificial-intelligence-ml/transformer-architecture-implementation.md) — Provides practical implementations of transformer and BERT architectures using self-attention mechanisms for text and visual tasks. ([source](https://github.com/wangshusen/deeplearning#readme))
- [Backpropagation Training](https://awesome-repositories.com/f/artificial-intelligence-ml/weight-reconstruction/discriminator-weight-updates/backpropagation-training.md) — Provides foundational implementations of backpropagation for computing gradients and optimizing neural network weights.
- [Actor-Critic Architectures](https://awesome-repositories.com/f/artificial-intelligence-ml/actor-critic-architectures.md) — Implements actor-critic architectures that combine policy-based agents with value-based evaluators to stabilize reinforcement learning training.
- [Input Sequence Attentions](https://awesome-repositories.com/f/artificial-intelligence-ml/attention-mechanisms/input-sequence-attentions.md) — Implements attention mechanisms that weight input sequence positions to capture long-range dependencies in text data.
- [Distributed Deep Learning](https://awesome-repositories.com/f/artificial-intelligence-ml/distributed-deep-learning.md) — Details strategies for scaling deep learning training across multiple nodes using parameter servers and federated learning.
- [Distributed Training Guides](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning-guides/distributed-training-guides.md) — Provides strategic guides for scaling model training using MapReduce, parameter servers, and federated learning.
- [Distributed Learning](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning/infrastructure/model-training-and-tuning/distributed-and-scaling-strategies/distributed-learning.md) — Implements strategies for scaling model training across multiple nodes using MapReduce, parameter servers, and federated learning. ([source](https://github.com/wangshusen/deeplearning#readme))
- [Transformer Architectures](https://awesome-repositories.com/f/artificial-intelligence-ml/natural-language-processing-implementations/transformer-architectures.md) — Implements transformer and BERT architectures using attention mechanisms for NLP and visual data tasks.
- [Generative Adversarial Networks](https://awesome-repositories.com/f/artificial-intelligence-ml/neural-network-implementations/generative-adversarial-networks.md) — Provides implementations of generative adversarial networks using competing generator and discriminator networks to synthesize data.
- [Parameter Servers](https://awesome-repositories.com/f/artificial-intelligence-ml/parameter-servers.md) — Implements parameter server architectures to synchronize model gradients across multiple computing nodes.
- [Reinforcement Learning Implementations](https://awesome-repositories.com/f/artificial-intelligence-ml/reinforcement-learning-implementations.md) — Implements reinforcement learning agents using value-based, policy-based methods and Monte Carlo tree search.

### Education & Learning Resources

- [Deep Learning Education](https://awesome-repositories.com/f/education-learning-resources/deep-learning-education.md) — Serves as a curated educational resource for learning neural network theory and practical implementation.
- [Machine Learning Fundamentals](https://awesome-repositories.com/f/education-learning-resources/technical-domain-education/ai-machine-learning-education/machine-learning-fundamentals.md) — Provides educational content and implementations for fundamental machine learning algorithms including regression, classification, and clustering.
- [Generative Model Examples](https://awesome-repositories.com/f/education-learning-resources/use-case-examples/generative-model-examples.md) — Provides practical examples of autoencoders and generative adversarial networks for synthetic image generation.

### Data & Databases

- [MapReduce Processing Engines](https://awesome-repositories.com/f/data-databases/mapreduce-processing-engines.md) — Implements MapReduce processing for splitting large datasets into chunks to accelerate parallel model training.