1 مستودع
Awesome GitHub RepositoriesPreference Alignment Objectives
Mathematical objectives used to align language model outputs with human preferences by optimizing the likelihood of preferred responses.
Distinct from Pruning Ratio Optimization: Distinct from Pruning Ratio Optimization: focuses on policy alignment via preference data rather than parameter reduction for resource efficiency.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Preference Alignment Objectives. Refine with filters or upvote what's useful.
Awesome Preference Alignment Objectives GitHub Repositories
اعثر على أفضل المستودعات باستخدام الذكاء الاصطناعي.سنبحث عن أفضل المستودعات المطابقة باستخدام الذكاء الاصطناعي.
- eric-mitchell/direct-preference-optimization
eric-mitchell/direct-preference-optimization
2,888عرض على GitHubThis project is a framework for aligning large language models with human preferences. It provides a library for optimizing model behavior by mapping preference data directly to a policy objective, bypassing the need for a separate reward model. The framework utilizes a closed-form mathematical objective to adjust model weights by maximizing the likelihood of preferred responses relative to dispreferred ones. It includes a toolkit for supervised fine-tuning, allowing users to establish a stable baseline on demonstration data before applying preference-based optimization techniques. The libra
Adjusts model weights by maximizing the likelihood of preferred responses relative to dispreferred ones using a closed-form mathematical objective.
Python
