1 repository
Awesome GitHub RepositoriesTransformer Tutorials
Step-by-step educational walkthroughs for implementing transformer models using the PyTorch framework.
Distinct from PyTorch Training Frameworks: Distinct from PyTorch Training Frameworks: focuses specifically on educational transformer implementation walkthroughs, not general PyTorch training infrastructure.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Transformer Tutorials. Refine with filters or upvote what's useful.
Awesome Transformer Tutorials GitHub Repositories
Găsește cele mai bune repo-uri cu AI.Vom căuta cele mai potrivite repository-uri folosind AI.
- karpathy/build-nanogpt
karpathy/build-nanogpt
4,746Vezi pe GitHubThis is an educational implementation that builds a generative pre-trained transformer (GPT) language model from scratch using PyTorch. The project is structured as a step-by-step tutorial, walking through the construction of a decoder-only transformer architecture and its training loop with clean git commits and an accompanying video lecture for a hands-on learning experience. What sets this implementation apart is its focus on practical reproduction: it provides a workflow to train a 124-million-parameter model from scratch in about one hour on cloud GPU hardware, costing under ten dollars.
Provides a step-by-step walkthrough for implementing a transformer language model using PyTorch.
Python
