2 Repos
Methods for refining model behavior to match human preferences and intent.
Distinguishing note: Focuses on post-training alignment and preference optimization rather than initial pre-training.
Explore 2 awesome GitHub repositories matching artificial intelligence & ml · Alignment Techniques. Refine with filters or upvote what's useful.
This project is a comprehensive framework for the entire lifecycle of transformer-based language models, supporting everything from foundational pretraining to specialized deployment. It provides a modular toolkit for defining neural network architectures, managing data preparation pipelines, and executing training routines across various scales. The framework is designed to handle the full model development process, including supervised fine-tuning, behavioral alignment, and the integration of agentic capabilities. What distinguishes this framework is its focus on efficient training and adva
Model behavior is aligned with human intent by mathematically maximizing the probability of preferred responses over rejected ones.
This project is a comprehensive technical reference and educational resource focused on the lifecycle of large language models. It provides structured learning materials that cover the foundational mechanics of transformer architectures, the mathematical principles of attention mechanisms, and the engineering practices required for modern generative artificial intelligence. The repository serves as a guide for both technical skill development and professional preparation, offering a curriculum that spans from model training and inference optimization to advanced alignment techniques. It detai
Covers post-training alignment techniques including reinforcement learning and retrieval-augmented generation.