1 repository
Pipelines that standardize raw input data through dynamic resizing, padding, and masking operations.
Explore 1 awesome GitHub repository matching data & databases · Data Collator Pipelines. Refine with filters or upvote what's useful.
Unsloth is a high-performance training and inference platform designed to optimize the lifecycle of large language and multimodal models. It provides a comprehensive engine for fine-tuning, executing, and managing models locally, with a focus on reducing memory consumption and increasing compute speed on consumer-grade hardware. The platform distinguishes itself through hand-optimized kernels and automated computational graph techniques that maximize hardware throughput. It supports advanced training methodologies, including reinforcement learning for reasoning and efficient adapter-based fin
Standardizes raw data through dynamic resizing, padding, and masking to ensure consistent batch structures during training.