1 repository
Concatenates numericalized texts into a single stream and splits it into contiguous sequences for language model training.
Distinct from Text Model Training: Distinct from Text Model Training: focuses on the batching and sequence splitting step, not the training loop itself.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Batching Utilities. Refine with filters or upvote what's useful.
This is a structured deep learning curriculum for programmers, delivered as a collection of Jupyter notebooks. It teaches the fundamentals of training neural networks for computer vision, natural language processing, tabular data analysis, and collaborative filtering using PyTorch and the fastai library. The course is designed to be hands-on, guiding learners from building a training loop from scratch to fine-tuning pretrained models for a variety of practical tasks. The curriculum distinguishes itself by covering the full lifecycle of a deep learning project, from data preparation and augmen
Provides batching utilities that concatenate and split text sequences for language model training.