thunlp/UltraFeedback

Features

• Feedback Alignment - Boosts language models using high-quality feedback signals.
• Model Alignment and Feedback - Boosts model performance using high-quality feedback data.
• Reinforcement Learning - Boosts model performance using high-quality preference feedback.