30 open-source projects similar to deepmind/pysc2, ranked by shared indexed features. Tags may describe platforms or build tools rather than the same primary purpose. Check each project’s use case, license, and deployment requirements before treating it as a replacement.
This project is a reinforcement learning toolkit and simulation-based AI trainer for creating intelligent agents within Unity simulations. It provides a multi-agent simulation framework for configuring cooperative or competitive scenarios and includes an environment wrapper that bridges simulations with standard machine learning libraries using gym-style interfaces. The system features a native cross-platform inference engine that executes trained neural network models for real-time decision making without external dependencies. It enables the acceleration of the learning process by running m
Lab is a customizable 3D platform and research testbed designed for training and testing autonomous agents using reinforcement learning. It serves as a spatial AI training simulator where agents can be evaluated through navigation and puzzle-solving tasks. The environment allows for the definition of complex layouts and task behaviors through external scripting, enabling the generation of specific challenges for AI research. It supports both automated training via standard API bindings and manual agent control to validate simulation dynamics. The system utilizes a grid-based spatial represen
PySC2 is a Python library that exposes StarCraft II as a reinforcement learning environment. Agents receive observations and send actions through repeated observe-and-act cycles, with one or two players in the same game session. It is built as a research platform for developing and benchmarking machine learning agents on a real-time strategy game with partial information and long-horizon planning. The way the game is presented to an agent is a central part of the project. Observations come as stacked feature layers for the screen and minimap, as rendered RGB images, or as raw unit data addres
Gym is a reinforcement learning environment toolkit and agent simulation framework. It provides a standardized API and a universal communication interface that defines how learning agents interact with simulation environments through actions and observations. The project includes a benchmark environment suite and a diverse library of pre-configured simulation worlds, including physics engines and classic control tasks. It enables the creation of custom simulation environments to train agents in specific operational scenarios while ensuring reproducibility across different learning algorithms.
Gymnasium is a suite of standardized APIs and simulation toolkits used to evaluate agent behavior and benchmark reinforcement learning algorithms. It provides a standardized interface for creating and interacting with simulated environments, enabling the training of reinforcement learning agents through a consistent set of interaction protocols. The project emphasizes experimental reproducibility through a versioned API and a system for tracking changes to environment logic using version suffixes. This ensures that learning results remain consistent and can be replicated across different soft
This project is an AI research implementation library and machine learning research repository. It provides a collection of reference code, illustrative implementations, and open-source research datasets used to verify hypotheses and build upon existing models in artificial intelligence. The repository focuses on scientific research reproduction by translating theoretical findings from published papers into executable code. It includes specialized scientific simulation environments designed to test the behavior of autonomous agents and models within controlled settings. The project covers AI
SerpentAI is a game AI development kit and computer vision framework designed for building autonomous agents that interact with video games. It serves as a game input automation tool and a machine learning model integration engine, allowing developers to create agents that perceive game states and execute actions. The framework utilizes a plugin-based agent architecture to provide modular extensions for game-specific logic and behaviors. It features a specialized system for training, bundling, and deploying machine learning classifiers to recognize visual contexts and game states in real time
This project is a comprehensive framework for building and managing autonomous agent systems. It provides a unified architecture for orchestrating multi-agent societies, where specialized agents collaborate through roleplay to decompose and solve complex tasks. The system integrates language models with external environments, enabling agents to perform real-world actions through a standardized tool-calling abstraction layer. The framework distinguishes itself through its focus on iterative reasoning and data reliability. It employs automated feedback loops to refine agent outputs and self-eva
PyGame Learning Environment is a Python framework that provides a standardized interface for training artificial intelligence agents within diverse game environments. It functions as a communication layer that bridges reinforcement learning agents with game state observations, action inputs, and reward signals, allowing for consistent interaction across different game titles. The platform distinguishes itself by offering a headless execution mode that disables graphical rendering pipelines. By bypassing display overhead, this feature accelerates training cycles for automated agents during bac
Agentverse is a multi-agent framework and orchestrator designed for deploying and managing multiple large language model agents. It provides a simulation environment where agents interact based on custom personas and defined interaction rules to solve tasks or simulate social dynamics. The system features a tool integration layer that connects agents to external functional plugins and specialized tools, extending their capabilities beyond text generation. It uses a combination of persona-based prompt injection and state-managed memory to maintain agent consistency and specialized skill sets d
FinRL is a reinforcement learning framework designed for the development, training, and backtesting of automated trading strategies. It functions as a quantitative finance toolkit that integrates deep learning algorithms with financial market simulations to address complex portfolio management and asset allocation tasks. The platform provides an end-to-end pipeline for transforming raw market data into actionable trading models. The project distinguishes itself through a layered, modular architecture that separates data processing, environment simulation, and agent training. This design allow
This project is an educational resource designed to teach the mathematical foundations and core algorithms of reinforcement learning. It provides a structured academic curriculum that combines textbooks, lecture materials, and practical code examples to guide learners through the principles of Markov decision processes and reinforcement learning theory. The repository distinguishes itself by integrating a grid-based simulation framework that allows users to test algorithms within custom environments. This environment supports the analysis of agent performance by rendering state values, polici
This project is a .NET implementation of the gRPC framework, providing a system for executing functions on remote servers as if they were local calls. It serves as a high-performance remote procedure call (RPC) framework that utilizes HTTP/2 for service connectivity and binary communication protocols to ensure efficient data exchange. The implementation includes a gRPC-Web proxy, which acts as a translation layer to enable browser-based applications to communicate with gRPC services through web-compatible requests. It further supports the creation of HTTP/2 service meshes to connect distribut
Isaac Lab is an open-source framework for training robot policies in physically simulated environments, supporting both single-agent and multi-agent reinforcement learning. It is built on an Omniverse-PhysX simulation backend that models rigid bodies, articulated systems, deformable objects, and sensors, and provides a task-based environment configuration system where each training environment is defined as a modular class specifying observation spaces, action spaces, reward functions, and termination conditions. The framework distinguishes itself through an RL-library abstraction layer that
Webots is a physics-based robot simulator and development environment used for modeling, programming, and testing the behavior of robots in a simulated 3D physical world. It serves as a virtual prototyping tool to verify mechanical and electronic systems through the creation of virtual robot models and control logic. The platform enables a full robotics simulation workflow, including the development of robot controllers and the programming of autonomous agent behaviors. It focuses on physical system modeling to represent the mechanical properties of hardware and simulate real-world interactio
s2client-proto provides a set of structured data definitions and language-neutral communication protocols used to exchange information between an external client and the StarCraft II engine. It utilizes protocol buffer definitions to establish a binary serialization schema for these data exchanges. The project defines the underlying communication layer necessary for game engine automation, game state analysis, and the development of software agents for competitive gaming. The framework covers interface definition languages to ensure compatibility across programming languages and employs sche
grpc-rust is a native gRPC framework for Rust designed for building high-performance remote procedure call clients and servers. It provides an asynchronous communication stack and a protocol buffers implementation for encoding, decoding, and generating type-safe code from service definitions. The project enables the implementation of unary and bi-directional data streaming over the HTTP/2 protocol. It includes specialized support for gRPC-Web integration, allowing browser-based clients to communicate with services through protocol translation. The infrastructure covers a broad range of distr
Legged Gym is a high-performance simulation platform and toolkit engineered for training autonomous robotic agents in complex, physics-based environments. It provides a comprehensive framework for developing legged locomotion control policies, enabling robots to learn movement strategies for navigating uneven terrain and managing physical disturbances through reinforcement learning. The platform distinguishes itself by utilizing hardware-accelerated physics and headless execution to maximize computational throughput during training. It incorporates a domain randomization pipeline that injects
Stable-baselines3 is a reinforcement learning library built on the PyTorch deep learning framework. It provides a collection of reliable, standardized implementations of reinforcement learning algorithms designed for training, testing, and benchmarking agent policies in diverse simulated environments. The library functions as an agent training toolkit that emphasizes modularity and reproducibility. It features a unified environment interface and supports vectorized execution to accelerate data collection across multiple simulation instances. Users can customize neural network architectures, f
This repository provides a comprehensive library of reinforcement learning algorithms designed for training autonomous agents. It serves as a research-oriented collection of implementations that cover fundamental decision-making strategies, including dynamic programming, temporal difference learning, and policy gradient methods. The project distinguishes itself by offering specialized frameworks for deep reinforcement learning and structured decision modeling. It includes implementations for deep Q-learning that utilize neural networks, experience replay, and prioritized sampling to approxima
Status: Archive (code is provided as-is, no updates expected)
Collections of robotics environments geared towards benchmarking multi-task and meta reinforcement learning
Massively parallel rigidbody physics simulation on accelerator hardware.
DeepMind Lab is a customisable three-dimensional simulation platform for training and evaluating learning agents. It is built on a modified fork of the Quake III Arena engine, adapted to render first-person worlds for agents rather than human players. The engine is written in C++ and built with Bazel, and it is exposed to Python so environments can be created, stepped, reset and observed from scripts, including through a standard reinforcement learning interface. The platform ships with a suite of navigation and puzzle-solving tasks, along with ready-made levels that test specific mental abil
DRL-robot-navigation is a deep reinforcement learning platform and robotic simulation framework designed to train autonomous mobile robots for collision-free path planning. It uses neural network policies and physics-engine simulation environments to teach robots how to navigate toward target coordinates while avoiding obstacles. The software trains continuous control policies using twin delayed deep deterministic policy gradients over continuous state and action spaces. Training is guided by scalar reward signals derived from target proximity and obstacle avoidance distances. System compone
AirSim is a high-fidelity simulation platform designed for the development and testing of autonomous vehicles. Built as a plugin for game engines, it provides a physics-based environment that models vehicle dynamics and sensor data, serving as a foundation for robotics research, computer vision training, and reinforcement learning. The platform distinguishes itself through its support for hardware-in-the-loop and software-in-the-loop testing, allowing developers to validate control logic and firmware against real-world signals or concurrent processes. It offers extensive programmatic control
Open-AutoGLM is an autonomous agent framework designed to perform complex user workflows on mobile devices. By translating natural language instructions into precise sequences of taps, scrolls, and text inputs, the system enables the automation of mobile application interactions and testing. The platform distinguishes itself through a combination of vision-language processing and reinforcement learning. It converts graphical user interfaces into structured data, allowing agents to parse screen elements and map natural language commands to coordinate-based actions. To ensure reliability, the s
This project is a Python-based educational framework designed to simulate reinforcement learning algorithms and environments. It serves as a platform for reproducing classic textbook examples, allowing users to study agent behavior, policy improvement, and the fundamental mechanics of decision-making in controlled settings. The library provides implementations for core reinforcement learning concepts, including temporal difference learning, Monte Carlo episode sampling, and tabular value function approximation. It enables the analysis of specific algorithmic behaviors, such as identifying and
ManiSkill is a GPU-accelerated robot simulation framework designed for training robotic manipulation skills, benchmarking learning algorithms, and generating synthetic datasets. It serves as a reinforcement learning environment where robot control policies can be developed and evaluated using parallelized physics and rendering on the GPU. The platform is distinguished by its ability to perform sim-to-real transfer, allowing policies trained in virtual environments to be deployed onto physical robotic hardware. It features ray-traced parallel rendering for producing high-frame-rate RGBD and se
This project is an educational repository of reinforcement learning agents and tutorials implemented using TensorFlow. It provides a practical codebase for both model-free and model-based learning agents, designed to demonstrate how AI agents learn through trial and error. The collection features detailed implementations of various algorithmic approaches, including Deep Q-Networks and Policy Gradient methods. It specifically covers Actor-Critic architectures for continuous and discrete action spaces, alongside Proximal Policy Optimization and Deep Deterministic Policy Gradients. The framewor