# karpathy/LLM101n

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/karpathy-llm101n).**

36,346 stars · 1,975 forks · archived

## Links

- GitHub: https://github.com/karpathy/LLM101n
- awesome-repositories: https://awesome-repositories.com/repository/karpathy-llm101n.md

## Description

LLM101n is an educational machine learning curriculum and open-source resource designed to teach the fundamental principles and practical implementation of large language models. It functions as a technical manual that guides users through the end-to-end process of building and training neural network architectures from scratch using a dynamic tensor library for automatic differentiation and GPU-accelerated computation.

The project distinguishes itself through interactive, notebook-based instruction that allows for real-time visualization of training processes. It supports rapid experimentation and model prototyping by utilizing memory-mapped data loading to handle large datasets efficiently and a modular architecture that separates data processing, model definition, and optimization loops.

The repository covers a broad range of machine learning engineering tasks, providing a structured environment for technical skill acquisition. It serves as a centralized archive for educational content and project documentation, maintaining all materials as version-controlled assets to ensure long-term accessibility and integration with standard development workflows.

## Tags

### Artificial Intelligence & ML

- [Neural Computation Frameworks](https://awesome-repositories.com/f/artificial-intelligence-ml/neural-computation-frameworks.md) — Utilizes dynamic tensor libraries to define and train neural network architectures through automatic differentiation.
- [Neural Network Implementations](https://awesome-repositories.com/f/artificial-intelligence-ml/neural-network-implementations.md) — Implements core neural network architectures and training pipelines from scratch to demonstrate fundamental mechanics.
- [Prototyping Environments](https://awesome-repositories.com/f/artificial-intelligence-ml/prototyping-environments.md) — Provides a lightweight environment for experimenting with model design and training configurations.

### Education & Learning Resources

- [Machine Learning Curricula](https://awesome-repositories.com/f/education-learning-resources/machine-learning-curricula.md) — Provides a comprehensive instructional program guiding students through the fundamental principles of large language models.
- [Open Source Learning Resources](https://awesome-repositories.com/f/education-learning-resources/open-source-learning-resources.md) — Facilitates self-paced study and collaborative exploration of complex technical subjects through accessible materials.
- [Interactive Notebooks](https://awesome-repositories.com/f/education-learning-resources/interactive-notebooks.md) — Delivers educational content through interactive documents that allow real-time code execution and model visualization.
- [Technical Manuals](https://awesome-repositories.com/f/education-learning-resources/technical-manuals.md) — Demonstrates the step-by-step construction and training of deep learning architectures from scratch.
- [Curriculum Development Tools](https://awesome-repositories.com/f/education-learning-resources/curriculum-development-tools.md) — Guides students through the end-to-end process of building and training modern artificial intelligence models.
- [Technical Skill Training](https://awesome-repositories.com/f/education-learning-resources/technical-skill-training.md) — Bridges the gap between theory and implementation through hands-on deep learning exercises.

### Data & Databases

- [Memory Mapping Utilities](https://awesome-repositories.com/f/data-databases/memory-mapping-utilities.md) — Maps large binary datasets directly into memory to minimize overhead during high-frequency training iterations.