24 open-source projects similar to skyworkai/skywork-reward-v2, ranked by shared indexed features. Tags may describe platforms or build tools rather than the same primary purpose. Check each project’s use case, license, and deployment requirements before treating it as a replacement.
Open-Instruct is a distributed training and instruction tuning framework for large language models. It functions as a coordinator for supervised fine-tuning, reinforcement learning from human feedback pipelines, and tool-use training, providing specialized roles for dataset curation and model alignment. The project distinguishes itself through a high-performance training architecture that utilizes actor-based distributed coordination and hybrid sharding to manage large GPU clusters. It implements advanced alignment techniques including direct preference optimization, group relative policy opt
1. STaR 2. Mesh Transformer JAX 1. Updates 3. Pretrained Models 1. GPT-J-6B 1. Links 2. Acknowledgments 3. License 4. Model Details 5. Zero-Shot Evaluations 4. Architecture and Usage 1. Fine-tuning 2. JAX Dependency 5. TODO
Forest-of-Thought: Scaling Test-Time Compute for Enhancing LLM Reasoning
Implementation of the training framework proposed in Self-Rewarding Language Model , from MetaAI
This repository contains projects that aims to equip large-scale pretrained language models with better programming and reasoning skills. These projects are presented by Microsoft Research Asia and Microsoft Azure AI.
Code for paper "LEVER: Learning to Verify Language-to-Code Generation with Execution". LEVER is a simple method that improves the code generation ability of large language models trained on code (CodeLMs), by learning to verify and rerank CodeLM-generated programs with their execution results.…
Deductive Beam Search Decoding Deducible Rationale for Chain-of-Thought Reasoning
Note: https://github.com/kyegomez/tree-of-thoughts CANNOT replicate paper results.
siiRL: Shanghai Innovation Institute RL Framework for Advanced LLMs and Multi-Agent Systems
This repository contains the code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing" (EMNLP 2024).
This is the official implementation of Graph of Thoughts: Solving Elaborate Problems with Large Language Models. This framework gives you the ability to solve complex problems by modeling them as a Graph of Operations (GoO), which is automatically executed with a Large Language Model (LLM) as…
Self-Play on Zero-Sum Games Incentivizes Reasoning via Multi-Agent Multi-Turn Reinforcement Learning
put the dataset under data/ Set the hyperparameters in train.slurm and execute bash train.slurm Set the hyperparameters in trainverifier.slurm and execute bash trainverifier.slurm After fine-tuning, specify the model path in mcts.slurm, execute bash mcts.slurm. Note that the provided script will…
📊 Main Results ✨ Getting Started • 📨 Contact • 🎈 Citation • 🌟 Star History
A domain-agnostic framework enabling VLM self-improvement through competitive visual games
SeRL: Self-Play Reinforcement Learning for Large Language Models with Limited Data
AIDE: AI-Driven Exploration in the Space of Code. The machine Learning engineering agent that automates AI R&D.
Official implementation of our Buffer of Thoughts (BoT) framework (NeurIPS 2024 Spotlight). Affiliation: Peking University, UC Berkeley, Stanford University
The official repository for "Parallel-R1: Towards Parallel Thinking via Reinforcement Learning".