1 repositorio
Awesome GitHub RepositoriesMultipacking
The process of grouping multiple short sequences into a single fixed-length block to maximize hardware throughput.
Distinct from Sequence Length Constraints: Distinct from general sequence length constraints by focusing on the packing of multiple examples into one block
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Multipacking. Refine with filters or upvote what's useful.
Awesome Multipacking GitHub Repositories
Encuentra los mejores repositorios con IA.Buscaremos los repositorios que mejor coincidan usando IA.
- openaccess-ai-collective/axolotl
OpenAccess-AI-Collective/axolotl
12,062Ver en GitHubAxolotl is a distributed training orchestrator and fine-tuning framework for large language models, multimodal systems, and quantized models. It provides a structured environment for specializing pre-trained models through full parameter updates or low-rank adaptation, as well as aligning model outputs with human expectations via preference tuning pipelines and reward modeling. The system distinguishes itself through a configuration-driven pipeline that manages preprocessing and training workflows via a single file for reproducibility. It implements high-throughput optimizations such as multi
Implements multipacking to group short training examples into fixed-length blocks for maximized GPU throughput.
Python
