This repository provides supplementary material for our paper Constitutional AI: Harmlessness from AI Feedback.
Die Hauptfunktionen von anthropics/constitutionalharmlessnesspaper sind: Reinforcement Learning, RLHF Frameworks.
Open-Source-Alternativen zu anthropics/constitutionalharmlessnesspaper sind unter anderem: openai/following-instructions-human-feedback — [Paper link][LINKTOPAPER]. rucaibox/rlmec — This repo provides the source code & data of our paper: Improving Large Language Models via Fine-grained Reinforcement… alibabaresearch/damo-convai — DAMO-ConvAI: The official repository which contains the codebase for Alibaba DAMO Conversational AI. ganjinzero/rrhf — Arxiv. openrlhf/openrlhf — OpenRLHF is a training framework and alignment library designed for reinforcement learning from human feedback across… uclaml/spin — The official implementation of Self-Play Fine-Tuning (SPIN).
Paper linkLINKTOPAPER
DAMO-ConvAI: The official repository which contains the codebase for Alibaba DAMO Conversational AI.
OpenRLHF is a training framework and alignment library designed for reinforcement learning from human feedback across distributed GPU clusters. It provides tools for aligning large language models and multimodal vision-language models using algorithms such as PPO, GRPO, and DPO. The framework distinguishes itself through a distributed inference engine that overlaps sample rollout with training to increase throughput. It supports scaling to models exceeding 70 billion parameters via parameter sharding and handles long-context sequences through ring-attention sequence parallelism. The project
