willccbb/verifiers

Features

• RL Environment Construction - Provides a standardized system for constructing simulation environments and harnesses to train and evaluate large language models.
• RL Environment Frameworks - Provides a standardized system for constructing simulation environments and training harnesses for LLM reinforcement learning.
• Rubric-Based Reward Scoring - Calculates model performance by mapping environment outputs against a predefined set of success criteria and reward values.
• RL Trajectory - Tracks token trajectories across multi-turn interactions, handling branching rollouts and truncated paths for RL training.
• LLM Evaluation Frameworks - Provides a system for measuring language model accuracy and performance using reward rubrics and datasets.
• Reinforcement Learning Environments - Offers a comprehensive toolkit for building standardized simulation environments and harnesses for LLM reinforcement learning.
• Agent Performance Evaluators - Assesses agent behavior and success rates through automated testing and ablation sweeps.
• Model Performance Evaluators - Tests model outputs against defined environments with terminal-based result visualization to quantify accuracy.
• Reinforcement Learning Reward Systems - Defines task datasets and reward rubrics to quantify and assign utility to agent actions for optimization.
• RL Training Workflows - Connects simulation environments to RL frameworks to optimize model performance based on defined rubrics.
• RL Training Harnesses - Implements a bridge connecting large language models to simulation environments for optimization based on specific task goals.
• Task Definitions - Implements a framework for setting up task datasets, model harnesses, and reward rubrics for LLM evaluation and training.
• Environment Module Packaging - Bundles task datasets and evaluation logic into self-contained units for remote deployment and standardized sharing.
• Model Agnostic Interfaces - Implements a common interface that decouples language model APIs from simulation environments to allow seamless model swapping.
• Agent Trajectory Logs - Tracks token trajectories, branching rollouts, and multi-turn interactions during reinforcement learning sessions.
• Episode Trajectory Recorders - Records the full sequence of token interactions and branching paths for post-hoc agent behavior analysis.
• Agent Performance Metrics - Analyzes agent success using pass-rate metrics and ablation sweeps via a dedicated terminal interface.
• RL Post-Training - Optimizes model performance by connecting simulation environments to RL frameworks for post-training.
• Component Ablation Studies - Provides systematic removal of environment parameters and model configurations to evaluate their contribution to success rates.
• RL Environment Publishing - Provides a system for uploading self-contained environment modules to a centralized hub for sharing and remote execution.
• Collaborative Research Environments - Enables collaborative research by packaging and publishing environment modules to a central hub for remote execution.
• Agent Performance Monitoring - Captures real-time interaction data and agent progress throughout live rollouts using monitoring rubrics.
• Evaluation Metric Monitors - Gathers and records performance data during agent interactions by applying monitoring rubrics to active sessions.
• Reinforcement Learning Frameworks - Reinforcement learning framework utilizing verifiable environments.

Star history