30 open-source projects similar to facebookresearch/motif, ranked by shared indexed features. Tags may describe platforms or build tools rather than the same primary purpose. Check each project’s use case, license, and deployment requirements before treating it as a replacement.
A large-scale, fine-grained, diverse preference dataset
verl is a distributed training system designed for large language model alignment and reinforcement learning. It provides a framework for executing post-training pipelines, including supervised fine-tuning and reinforcement learning from human feedback, to refine model behavior and agentic capabilities. The system utilizes a hybrid training and inference engine that optimizes memory and communication when switching between model generation and gradient updates. It supports multi-modal reinforcement learning for models processing both image and text data, and implements algorithms such as PPO
[Website](https://eureka-research.github.io) [arXiv](https://arxiv.org/abs/2310.12931) [PDF](https://eureka-research.github.io/assets/eureka_paper.pdf)
This repo provides the source code & data of our paper: Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing Constraint (arXiv 2024)
Align-anything is a multi-modal large language model alignment framework designed to fine-tune models across text, image, video, and audio. It functions as a distributed training orchestrator and toolkit for implementing preference-based learning to ensure model behaviors match human intentions and values. The framework provides specialized pipelines for Supervised Fine-Tuning and Direct Preference Optimization. It includes a high-performance inference engine wrapper for actor models to reduce sequence generation time and a dedicated training environment for refining vision-language-action mo
LMFlow is a comprehensive suite for large language model fine-tuning, context extension, multimodal processing, and inference execution. It provides a toolkit for updating model parameters through full tuning or memory-efficient adapter algorithms, alongside an inference engine for executing tuned models via command-line or web-based interfaces. The framework includes a dedicated alignment suite for supervised tuning and reward model training to refine model behavior. It features a context window extender to increase maximum input lengths and a multimodal framework for building chatbots that
This is an open-source framework for building stateful, durable AI agents that run on Cloudflare Workers. It provides a runtime for long-lived agents that maintain a persistent identity, local SQL storage, and real-time connections, utilizing a lifecycle where agents hibernate when idle and wake on demand. The project distinguishes itself through its multi-channel orchestration, allowing a single agent to be deployed across voice, email, and chat interfaces with unified state. It implements the Model Context Protocol for standardized tool and data exchange and includes a dedicated framework f
QChatGPT is an LLM bot orchestration platform and multi-platform chatbot gateway. It serves as a bridge that routes messages between various instant messaging services and AI models using a unified codebase, functioning as an agentic workflow manager to handle complex multi-turn dialogues. The platform distinguishes itself through an extensible plugin framework that allows for the addition of custom logic and event-driven features via standardized protocols. It also includes a web-based bot controller, providing a browser interface to manage bot behavior and monitor real-time performance with
Lobe Chat is a self-hosted AI platform that provides a web-based interface for interacting with multiple large language models. It functions as an AI agent orchestrator, allowing for the design, scheduling, and management of autonomous agent teams to perform operational tasks. The platform features an extensible plugin framework and SDK to integrate external tools and custom function calls into workflows. It utilizes a provider-agnostic model layer to unify various AI APIs and includes a context-aware memory system to store structured user information for personalized interactions. The syste
LMOps is a research-driven operations framework for optimizing the deployment, fine-tuning, and performance of large language models. It provides a specialized toolkit for foundation model adaptation, inference acceleration, prompt optimization, and context orchestration. The framework distinguishes itself through an inference accelerator that reduces token generation latency by verifying and copying overlapping text spans from reference documents. It also features a prompt engineering optimizer that employs reinforcement learning, beam search, and non-natural language markers to automaticall
Ludwig is a declarative machine learning framework designed for training neural networks and large language models using configuration files instead of manual coding. It functions as a multimodal model builder and a low-code tool for supervised fine-tuning, allowing users to build models that process mixed inputs of text, images, audio, and tabular data. The project distinguishes itself through an automated hyperparameter optimizer and a system for large language model fine-tuning using parameter-efficient adapters. It features a multimodal data pipeline and the ability to automatically gener
A replica of the AlphaZero methodology for deep reinforcement learning in Python
A short and easy implementation of Quantile Regression DQN | Distributional Reinforcement Learning
This repository provides supplementary material for our paper Constitutional AI: Harmlessness from AI Feedback.
⚡️A Blazing-Fast Python Library for Ranking Evaluation, Comparison, and Fusion 🐍
Welcome to drlzh.ai: a hands-on deep reinforcement learning course where you build the algorithms, not just read about them.
FinRL is a reinforcement learning framework designed for the development, training, and backtesting of automated trading strategies. It functions as a quantitative finance toolkit that integrates deep learning algorithms with financial market simulations to address complex portfolio management and asset allocation tasks. The platform provides an end-to-end pipeline for transforming raw market data into actionable trading models. The project distinguishes itself through a layered, modular architecture that separates data processing, environment simulation, and agent training. This design allow
TensorFlow implementation of Deep Reinforcement Learning papers
This repository contains the implementation of DISCERN in Python. You can download the manuscript from my website or arXiv.
A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).
Tensorflow Keras OpenAI Gym implementation of 1-step Q Learning from "Asynchronous Methods for Deep Reinforcement Learning"
Gymnasium-based benchmarking suite for testing RL algorithms on real-world scenarios
DAMO-ConvAI: The official repository which contains the codebase for Alibaba DAMO Conversational AI.