Open-source alternatives to SimpleRL Reason

TensorLayer is a backend-agnostic tensor library and deep learning framework designed for building neural network architectures. It provides a neural network abstraction layer that allows model logic to run across different deep learning engines using high-level layers and model components. The project serves as a deep reinforcement learning toolkit for implementing policy-based, value-based, and actor-critic agents. It includes specialized tools for managing experience replay and gradient-based policy optimization to handle both discrete and continuous action spaces. To support reinforcemen

This project provides a comprehensive technical guide and framework for engineering large-scale machine learning systems. It covers the full lifecycle of model development, focusing on the infrastructure and computational principles required to build, train, and serve generative AI models across distributed GPU clusters. The repository distinguishes itself by offering deep-dive tutorials and implementation strategies for complex system challenges. It emphasizes high-performance architectural primitives, such as collective communication orchestration, distributed tensor sharding, and static gr

This repository provides a comprehensive library of reinforcement learning algorithms designed for training autonomous agents. It serves as a research-oriented collection of implementations that cover fundamental decision-making strategies, including dynamic programming, temporal difference learning, and policy gradient methods. The project distinguishes itself by offering specialized frameworks for deep reinforcement learning and structured decision modeling. It includes implementations for deep Q-learning that utilize neural networks, experience replay, and prioritized sampling to approxima

LLM-RL-Visualized is a visual reference library and collection of knowledge maps designed to explain Large Language Model and Reinforcement Learning algorithms. It provides a structured system of conceptual diagrams and taxonomies covering the intersection of language model alignment and reinforcement learning. The project distinguishes itself through detailed visual mappings of complex workflows, such as the coordination of reward models and policy optimization in reinforcement learning from human feedback. It contrasts different preference optimization architectures, such as RLHF and Direct

This project is a Python-based educational framework designed to simulate reinforcement learning algorithms and environments. It serves as a platform for reproducing classic textbook examples, allowing users to study agent behavior, policy improvement, and the fundamental mechanics of decision-making in controlled settings. The library provides implementations for core reinforcement learning concepts, including temporal difference learning, Monte Carlo episode sampling, and tabular value function approximation. It enables the analysis of specific algorithmic behaviors, such as identifying and

VLM-R1 is a reasoning vision-language model and embodied AI framework designed to map visual inputs and language instructions into physical navigation waypoints and robotic actions. It functions as a multimodal policy optimizer and an open vocabulary detector capable of locating objects based on arbitrary natural language descriptions. The system distinguishes itself through the use of chain-of-thought reasoning and reinforcement learning to solve complex visual and spatial tasks. It utilizes a video semantic memory system, which employs a visual cache to maintain a history of live video for

Agent Lightning is an optimization framework designed to refine the performance of individual AI agents within complex multi-agent systems. It provides a platform for improving decision-making and task execution by applying reinforcement learning, supervised fine-tuning, and automated prompt optimization. The framework distinguishes itself through its ability to isolate specific agents for targeted tuning, allowing developers to enhance individual behaviors while maintaining the stability of the broader system architecture. By utilizing a modular interface, it integrates with diverse agent fr

Giskard is an evaluation framework, testing library, and quality monitoring system for large language models and AI agents. It serves as a toolkit for quantifying model performance and reliability, providing specialized capabilities for validating retrieval-augmented generation pipelines. The project distinguishes itself through an automated red teaming tool and security scanner designed to identify vulnerabilities, prompt injections, and safety risks. It utilizes adversarial probing and synthetic edge case generation to quantify model robustness and detect information disclosure. The platfo

This library provides a comprehensive framework for fine-tuning, aligning, and distilling transformer-based language models. It serves as a toolkit for adapting models to specialized domains through supervised learning, while offering advanced methodologies to improve output quality and reasoning capabilities. The project distinguishes itself through specialized alignment and optimization techniques, including direct preference optimization and reinforcement learning, which allow models to be tuned against human preferences without complex reward modeling. It further supports training efficie

DeepMimic is a deep reinforcement learning framework and physics-based motion imitation tool designed to teach simulated characters and robots to reproduce human movements. It provides a pipeline for integrating motion capture data into physics simulations to train agents that can mimic complex physical skills. The system utilizes the PyBullet simulation environment to execute motion policies and visualize character interactions in real time. It includes a motion capture integration pipeline that imports and processes animation sequences to serve as reference targets for imitation learning ag

Tianshou is a reinforcement learning framework designed for developing and testing agents. It provides a system for implementing custom agents by defining policies and parameter update rules to optimize agent behavior. The framework decouples neural network architectures from update logic through policy-based abstractions and separates data pre-processing from gradient updates. It utilizes a collector-driven pipeline to stream experience from environments into structured memory buffers for sampled learning. The system supports vectorized environment execution to run multiple parallel instanc

Minigo is a TensorFlow-based reinforcement learning engine designed to master the game of Go. It functions as a comprehensive system for training neural networks to predict board policies and game outcomes, utilizing a model trainer to generate self-play data and optimize weights. The project is distinguished by its ability to perform large-scale game simulations using Kubernetes to distribute worker nodes across CPU, GPU, and TPU hardware. It employs a Monte Carlo Tree Search implementation to identify optimal moves and supports specialized hardware acceleration, including inference on Edge

Stable-baselines3 is a reinforcement learning library built on the PyTorch deep learning framework. It provides a collection of reliable, standardized implementations of reinforcement learning algorithms designed for training, testing, and benchmarking agent policies in diverse simulated environments. The library functions as an agent training toolkit that emphasizes modularity and reproducibility. It features a unified environment interface and supports vectorized execution to accelerate data collection across multiple simulation instances. Users can customize neural network architectures, f

This project is a game AI training framework designed to develop and monitor reinforcement learning agents within a legacy game environment. It functions as a training and monitoring system that optimizes autonomous agents to complete game objectives through exploration and reward-based learning. The framework includes tools for game memory mapping and real-time trajectory visualization. These capabilities translate raw game memory addresses into visual coordinates, allowing agent movements and session data to be streamed to a map for the analysis of navigation patterns and area exploration.

WizardLM is a large language model and instruction-tuning framework designed to execute sophisticated coding, mathematical, and conversational tasks. It functions as an AI system for mathematical reasoning and code generation, as well as a synthetic dataset generator used to train other language models. The project is distinguished by its evolutionary instruction tuning, which uses a method to rewrite simple instructions into complex tasks. This process expands training dataset difficulty and produces a high volume of open-domain tasks across various difficulty levels. The system covers capa

This project is a machine learning implementation library featuring a collection of code examples that implement supervised, unsupervised, and reinforcement learning algorithms from scratch. It provides a comprehensive set of toolkits for core machine learning components, including a natural language processing toolkit, a reinforcement learning framework, and suites for data dimensionality reduction and pattern mining. The library includes specialized implementations for reinforcement learning, such as Q-Learning, Deep Q-Networks, and Actor-Critic agents. The natural language processing capab

HRM is an automated reasoning engine and language framework designed to execute complex, multi-scale problem solving. It functions as a reinforcement learning agent that continuously updates internal knowledge representations to improve task performance based on incoming data streams. The system distinguishes itself through a hierarchical architecture that coordinates abstract, long-term planning with granular, low-level logic. By integrating evolutionary algorithms and reinforcement learning, the framework refines model parameters and weights over successive generations, ensuring that intern

This project is an educational platform and research toolkit designed to teach deep learning through a combination of mathematical theory, visual diagrams, and executable code. It provides a comprehensive environment for building, training, and evaluating neural networks, grounding complex concepts in interactive computational notebooks that allow for hands-on experimentation. The framework distinguishes itself by interleaving theoretical foundations—including linear algebra, calculus, and probability—with practical implementations across multiple industry-standard libraries. It supports flex

This project is an educational resource designed to teach the mathematical foundations and core algorithms of reinforcement learning. It provides a structured academic curriculum that combines textbooks, lecture materials, and practical code examples to guide learners through the principles of Markov decision processes and reinforcement learning theory. The repository distinguishes itself by integrating a grid-based simulation framework that allows users to test algorithms within custom environments. This environment supports the analysis of agent performance by rendering state values, polici

Horizon is a reinforcement learning platform designed for training, evaluating, and deploying agents and contextual bandits using historical data. It serves as an off-policy engine and offline policy evaluation tool, allowing decision-making policies to be optimized and tested without the need for a live simulator. The framework specializes in recommendation system optimization, specifically using slating-based reinforcement learning to optimize the ordering and sequencing of multiple recommendations. It also functions as a contextual bandit framework that manages the balance between explorat

Pwnagotchi is an AI-powered wireless auditor and handshake capture tool that uses deep reinforcement learning to autonomously collect wireless security handshakes and crackable key material. It serves as an automation framework for network instrumentation, adapting its operational parameters based on the local wireless environment to maximize data collection. The system distinguishes itself through distributed coordination, allowing multiple hardware units to share presence and divide wireless channels to optimize collective capture and perform distributed wireless mapping. It incorporates ge

This project is a comprehensive collection of practical code examples and implementation libraries for machine learning. It provides a wide array of reference materials for building supervised, unsupervised, and reinforcement learning algorithms. The repository serves as a multi-domain resource, featuring specific implementation suites for financial AI, Bayesian statistical modeling, and deep learning architectures. It includes a framework for training intelligent agents using policy gradients and actor-critic models, as well as practical guides for fine-tuning transformers and utilizing larg

keras-rl is a reinforcement learning library that enables the training of neural agents using Keras. It serves as a framework for implementing deep reinforcement learning agents that interact with simulated environments to discover optimal behaviors and maximize cumulative rewards. The library provides a system for configuring, training, and managing neural network agents. It handles the interaction loop between agents and environments, allowing models to learn through direct experience and gradient-based optimization. The framework includes capabilities for model weight management, allowing

dm_control is a physics-based simulation framework and robot control simulation toolkit designed for creating and interacting with continuous control tasks. It serves as a suite of reinforcement learning environments and a benchmarking tool for evaluating autonomous agents within virtual physics spaces. The framework provides a collection of environments based on MuJoCo physics bindings to simulate rigid body dynamics and contact forces. It features hardware-accelerated rendering and interactive viewers for the visualization of physics environments and agent behavior. The system supports the

Hands-on-RL is an interactive educational resource and collection of Jupyter notebooks designed for learning reinforcement learning. It combines technical theory with practical, runnable code to demonstrate the implementation and training of mainstream reinforcement learning agents. The project focuses on bridging the gap between theory and practice through a tutorial structure that organizes explanations and executable code blocks sequentially. It enables the prototyping of reinforcement learning models to observe their behavior and performance in real-time. The implementation utilizes a mo

This project is a collection of deep learning research papers translated into annotated code. It serves as a resource for reproducing academic research, providing implementations of transformers, diffusion models, and reinforcement learning architectures. The library distinguishes itself by using a side-by-side annotation format that combines executable Python code with descriptive markdown notes. This approach provides a structured way to explain the logic of neural network papers alongside their PyTorch-based implementations. The codebase covers several major capability areas, including ge