awesome-repositories.com
Blog
MCP
awesome-repositories.com

Discover the best open-source repositories with AI-powered search.

ExploreCurated searchesOpen-source alternativesSelf-hosted softwareBlogSitemap
ProjectMCP serverAboutHow we rankPress
LegalPrivacyTerms
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com

Neural Network Implementation Projects

Ranking updated Jun 30, 2026

For a project for learning deep learning fundamentals, the first results are mnielsen/neural-networks-and-deep-learning (This repository implements a neural network from scratch using pure NumPy on MNIST, with step-by-step explanations of backpropagation and gradient descent in Jupyter notebooks — it is the classic educational resource for this exact topic), iamtrask/grokking-deep-learning and rasbt/deeplearning-models. trekhleb/homemade-machine-learning and eriklindernoren/ml-from-scratch round out the shortlist. Compare the match explanations and check the project documentation against your requirements.

Explore open-source repositories that guide you through building neural networks from scratch using fundamental programming concepts.

Neural Network Implementation Projects

Find the best repos with AI.We'll search the best matching repositories with AI.
  • mnielsen/neural-networks-and-deep-learningmnielsen avatar

    mnielsen/neural-networks-and-deep-learning

    17,721View on GitHub↗

    This project is a comprehensive educational resource and curriculum designed to teach the mathematical foundations and practical implementation of neural networks. It provides a structured path for understanding how computers learn from data, covering core concepts such as gradient descent, backpropagation, and the biological inspiration behind artificial neurons. The platform distinguishes itself by combining theoretical proofs with hands-on implementation exercises. It demonstrates the universal approximation theorem through visual explanations and guides users in building various architect

    This repository implements a neural network from scratch using pure NumPy on MNIST, with step-by-step explanations of backpropagation and gradient descent in Jupyter notebooks — it is the classic educational resource for this exact topic.

    PythonActivation FunctionsBackpropagationStochastic Gradient Descent
    View on GitHub↗17,721
  • iamtrask/grokking-deep-learningiamtrask avatar

    iamtrask/Grokking-Deep-Learning

    7,707View on GitHub↗

    Grokking-Deep-Learning is a collection of educational resources and courseware designed to teach the construction of neural networks from scratch. It serves as a programming tutorial and implementation guide for understanding the internal mechanics of deep learning. The project focuses on building various network architectures, including convolutional, recurrent, and long short-term memory networks. It provides step-by-step implementations of fundamental mechanisms such as forward propagation, backpropagation, and gradient descent. The material covers a broad range of deep learning capabilit

    This repository is a comprehensive Jupyter-notebook-based tutorial that builds neural networks from scratch using NumPy, covering forward/backpropagation, gradient descent, and activation functions—exactly matching the educational “implement from scratch” intent with clean explanations and foundational implementations.

    Jupyter NotebookNeural Network Training from Scratch
    View on GitHub↗7,707
  • rasbt/deeplearning-modelsrasbt avatar

    rasbt/deeplearning-models

    17,427View on GitHub↗

    This repository is an educational collection of deep learning implementations designed to demonstrate the fundamental principles of neural network architecture and optimization. It provides a comprehensive resource for understanding machine learning through hands-on code examples, ranging from basic multilayer perceptrons to complex generative models. The project distinguishes itself by emphasizing the manual construction of models, including the implementation of backpropagation from scratch to illustrate core mathematical mechanics. It covers a wide array of architectural design patterns, s

    This repository is an educational collection that implements neural networks manually using NumPy, with detailed coverage of backpropagation from scratch, activation functions, and gradient descent training, all in Jupyter notebooks—ideal for understanding the underlying math and algorithms.

    Jupyter NotebookBackpropagation Implementations
    View on GitHub↗17,427
  • trekhleb/homemade-machine-learningtrekhleb avatar

    trekhleb/homemade-machine-learning

    24,608View on GitHub↗

    This project provides a collection of machine learning algorithms implemented from scratch in Python. It serves as an educational resource using interactive notebooks that combine code with mathematical explanations to demonstrate the first principles of data science. The repository includes reference implementations for neural networks, such as multilayer perceptrons with backpropagation, and supervised learning models including linear and logistic regression. It also covers unsupervised learning through k-means clustering and Gaussian anomaly detection. The codebase covers a broad range of

    trekhleb/homemade-machine-learning is an educational collection of pure NumPy machine learning implementations in Jupyter notebooks, including multilayer perceptrons with backpropagation and gradient descent — exactly the kind of hands-on, from-scratch tutorial you want to understand the math and algorithms behind neural networks.

    Jupyter NotebookBackpropagationGradient Descent Algorithms
    View on GitHub↗24,608
  • eriklindernoren/ml-from-scratcheriklindernoren avatar

    eriklindernoren/ML-From-Scratch

    31,918View on GitHub↗

    This project is an educational toolkit that provides implementations of fundamental machine learning algorithms built from scratch. By avoiding high-level library abstractions, it serves as a pedagogical reference for understanding the mathematical foundations and core mechanics of supervised learning, unsupervised learning, and reinforcement learning models. The repository distinguishes itself through a modular approach to model construction, allowing users to build custom neural networks by chaining independent functional blocks. It covers a wide range of techniques, including gradient-base

    This repository provides pure NumPy implementations of neural networks and other ML algorithms from scratch, covering backpropagation, activation functions, and gradient descent training, making it a comprehensive educational resource for understanding the underlying math and mechanics.

    PythonMachine Learning ToolkitsSupervised LearningClustering Algorithms
    View on GitHub↗31,918
  • dennybritz/nn-from-scratchdennybritz avatar

    dennybritz/nn-from-scratch

    2,275View on GitHub↗

    Implementing a Neural Network from Scratch

    This Jupyter Notebook walks through building a neural network from scratch with pure NumPy, covering backpropagation, activation functions, and gradient descent, making it an ideal hands-on tutorial for understanding the math behind neural networks.

    Jupyter NotebookMachine Learning and AINeural Network Architectures
    View on GitHub↗2,275
  • karpathy/nn-zero-to-herokarpathy avatar

    karpathy/nn-zero-to-hero

    20,351View on GitHub↗

    This project is an educational resource and pedagogical framework designed to teach the fundamental mechanics of neural networks and gradient-based optimization. It provides a series of tutorials and code examples that guide users through building deep learning models from scratch, focusing on the implementation of core mathematical primitives and the underlying logic of backpropagation. The project distinguishes itself by providing a custom automatic differentiation engine that tracks mathematical operations in a dynamic computational graph. By implementing reverse-mode automatic differentia

    This repository is a highly regarded tutorial series that teaches building neural networks from scratch with a custom autograd engine and clear explanations in Jupyter notebooks, fitting your intent for educational content — though it uses its own scalar autograd rather than a pure NumPy implementation as highlighted in your features.

    Jupyter NotebookReverse-Mode Differentiation
    View on GitHub↗20,351
  • assemblyai-community/machine-learning-from-scratchAssemblyAI-Community avatar

    AssemblyAI-Community/Machine-Learning-From-Scratch

    971View on GitHub↗

    Machine-Learning-From-Scratch is an educational repository that provides implementations of fundamental machine learning models built using standard Python programming logic. It serves as a resource for understanding the internal mechanics of common statistical and predictive algorithms by constructing them from the ground up rather than relying on high-level machine learning frameworks. The project distinguishes itself by prioritizing transparency in algorithmic design, utilizing mathematical primitives and vectorized array computations to expose the underlying calculus and statistical logic

    This repository implements popular machine learning algorithms from scratch in Python, which aligns with the goal of understanding neural networks manually, though it is not exclusively focused on neural networks and may lack the tutorial-style explanations, Jupyter notebooks, or explicit MNIST example that the search targets.

    PythonMachine Learning ImplementationsFrom-Scratch ML Model ImplementationsMachine Learning Education
    View on GitHub↗971
  • stephencwelch/neural-networks-demystifiedstephencwelch avatar

    stephencwelch/Neural-Networks-Demystified

    1,361View on GitHub↗

    Neural Networks Demystified is an educational resource consisting of interactive Python notebooks designed to explain the fundamental mathematical concepts behind neural networks. It serves as a tutorial for understanding how these models process data and learn from patterns through supervised learning implementations. The project functions as a visualization tool that demonstrates core mechanics such as forward propagation and gradient descent. By utilizing notebook-driven execution, it allows for the inspection of intermediate data states and mathematical transformations as they occur durin

    This repo provides the Jupyter Notebook code that accompanies the "Neural Networks Demystified" video series, so it's squarely a hands-on tutorial for implementing neural networks from scratch, though the standalone explanatory depth depends on watching the videos.

    Jupyter NotebookGradient Descent Algorithms
    View on GitHub↗1,361
  • rasbt/llms-from-scratchrasbt avatar

    rasbt/LLMs-from-scratch

    97,260View on GitHub↗

    This repository serves as an educational framework for building large language models from the ground up. It provides a structured curriculum that guides learners through the end-to-end lifecycle of model development, including data processing, architecture design, and optimization. By focusing on low-level implementation, the project enables users to master the fundamental mechanics of artificial intelligence without relying on high-level abstraction frameworks. The project distinguishes itself by constructing neural network components and gradient-based optimization logic from first princip

    This repo teaches building large language models from scratch using PyTorch, which is more advanced and higher-level than the pure NumPy implementation of a simple neural network (like MLP for MNIST) you're seeking, so it does not match your tutorial's scope.

    Jupyter NotebookBackpropagation ImplementationsInteractive NotebooksEducational Neural Network Implementations
    View on GitHub↗97,260
  • imagineailab/ai-by-hand-excelImagineAILab avatar

    ImagineAILab/ai-by-hand-excel

    6,177View on GitHub↗

    This project consists of interactive spreadsheet-based models designed to demonstrate the mathematical mechanics of backpropagation, multi-layer perceptrons, and transformer attention. It serves as an Excel-based neural network simulator for manually calculating tensor operations and matrix multiplications to visualize data flow. The models provide a way to visualize the internal logic of neural networks by implementing self-attention and backpropagation through explicit cell formulas. It includes specific mathematical exercises for modeling transformer architecture and the layers of multi-la

    This repository teaches neural network math via interactive Excel spreadsheets rather than Python/NumPy code, so while it covers backpropagation and transformers for educational purposes, it does not match the code-based implementation approach with Jupyter notebooks and MNIST that you are looking for.

    Backpropagation ImplementationsEducational Neural Network Implementations
    View on GitHub↗6,177
  • tiny-dnn/tiny-dnntiny-dnn avatar

    tiny-dnn/tiny-dnn

    6,019View on GitHub↗

    tiny-dnn is a header-only C++14 deep learning framework for building, training, and running inference on neural networks. It constructs static computational graphs at compile time using template-based layer composition, with a gradient-based backpropagation engine and minibatch stochastic gradient descent for training, all without external dependencies beyond the C++14 standard library. The framework supports importing pre-trained models from the Caffe framework directly, parsing its binary serialization format without requiring external protocol buffer libraries. It provides CPU-optimized te

    This is a header-only C++ deep learning framework with built-in backpropagation and training, but it is a production-oriented library rather than an educational tutorial that teaches manual implementation in Python with NumPy and Jupyter notebooks.

    C++Activation FunctionsMNIST Dataset StudiesStochastic Gradient Descent
    View on GitHub↗6,019
Compare the top 10 at a glance
RepositoryStarsLanguageLicenseLast push
mnielsen/neural-networks-and-deep-learning17.7KPython—Jun 2, 2024
iamtrask/grokking-deep-learning7.7KJupyter Notebook—Jun 1, 2024
rasbt/deeplearning-models
17.4K
Jupyter Notebook
mit
Feb 8, 2024
trekhleb/homemade-machine-learning24.6KJupyter NotebookMITNov 23, 2025
eriklindernoren/ml-from-scratch31.9KPythonMITOct 15, 2023
dennybritz/nn-from-scratch2.3KJupyter NotebookMITAug 14, 2023
karpathy/nn-zero-to-hero20.4KJupyter NotebookmitAug 18, 2024
assemblyai-community/machine-learning-from-scratch971PythonMITJan 9, 2024
stephencwelch/neural-networks-demystified1.4KJupyter Notebook—Aug 19, 2023
rasbt/llms-from-scratch97.3KJupyter NotebookNOASSERTIONJun 2, 2026

Related searches

  • Deep learning framework
  • a structured learning path for neural networks
  • a collection of deep learning project examples
  • a free curriculum for learning machine learning
  • a library for building deep learning models
  • a collection of coding projects for practice
  • a project for understanding web frameworks
  • a list of projects to build for practice