awesome-repositories.com
Blog
MCP
awesome-repositories.com

Discover the best open-source repositories with AI-powered search.

ExploreCurated searchesOpen-source alternativesSelf-hosted softwareBlogSitemap
ProjectMCP serverAboutHow we rankPress
LegalPrivacyTerms
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
ikostrikov avatar

ikostrikov/pytorch-a2c-ppo-acktr-gail

0
View on GitHub↗
3,901 stars·843 forks·Python·MIT·18 views

Pytorch A2c Ppo Acktr Gail

This is a PyTorch reinforcement learning library designed for training agents in simulation environments. It provides a collection of deep reinforcement learning algorithms focusing on policy gradient methods and trust-region optimization.

The library implements a suite of policy gradient algorithms, including A2C and PPO, alongside a framework for imitation learning using Generative Adversarial Imitation Learning. It specifically features a scalable implementation of the ACKTR algorithm, utilizing Kronecker-factored approximations to enable efficient trust-region optimization.

The codebase covers broader capabilities including standardized environment interfaces for simulation integration, experience-based batch processing, and tools for visualizing agent behavior and training progress.

Features

  • Reinforcement Learning Training - Provides a comprehensive framework for training deep reinforcement learning agents in simulation environments using PyTorch.
  • Actor-Critic Architectures - Utilizes actor-critic architectures with separate networks for action probabilities and state value estimation.
  • Kronecker-Factored Trust Region Methods - Implements Kronecker-factored approximations to scale trust-region optimization for large neural networks with lower compute costs.
  • Policy Gradient Methods - Ships a suite of policy gradient algorithms, including A2C and PPO, for optimizing agent behavior.
  • Proximal Policy Optimization - Provides advanced policy optimization through methods such as Proximal Policy Optimization and trust-region updates.
  • PyTorch Reinforcement Learning Libraries - Offers a collection of standard deep reinforcement learning algorithms implemented in PyTorch for simulation environments.
  • Trust Region Policy Optimization - Supports scaled trust-region policy optimization using Kronecker-factored approximations for stable and efficient updates.
  • Simulation Training Environments - Integrates deep learning models with physics engines and game simulators for behavioral training and testing.
  • Adversarial Imitation - Enables agents to mimic expert behavior using generative adversarial imitation learning frameworks.
  • Clipped Policy Objectives - Implements clipped surrogate objectives within PPO to maintain training stability and prevent catastrophic performance drops.
  • Environment Wrappers - Offers a standardized API wrapper to decouple reinforcement learning agent logic from various simulation engine physics.
  • Simulation Environment Interfacing - Implements a standardized interface for connecting agents to simulated environments for action-reward based learning.

Star history

Star history chart for ikostrikov/pytorch-a2c-ppo-acktr-gailStar history chart for ikostrikov/pytorch-a2c-ppo-acktr-gail

How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.

AI search

Explore more awesome repositories

Describe what you need in plain English — the AI ranks thousands of curated open-source projects by relevance.

Start searching with AI

Frequently asked questions

What does ikostrikov/pytorch-a2c-ppo-acktr-gail do?

This is a PyTorch reinforcement learning library designed for training agents in simulation environments. It provides a collection of deep reinforcement learning algorithms focusing on policy gradient methods and trust-region optimization.

What are the main features of ikostrikov/pytorch-a2c-ppo-acktr-gail?

The main features of ikostrikov/pytorch-a2c-ppo-acktr-gail are: Reinforcement Learning Training, Actor-Critic Architectures, Kronecker-Factored Trust Region Methods, Policy Gradient Methods, Proximal Policy Optimization, PyTorch Reinforcement Learning Libraries, Trust Region Policy Optimization, Simulation Training Environments.

Which projects share features with ikostrikov/pytorch-a2c-ppo-acktr-gail?

Projects with overlapping indexed features include: openai/baselines — Baselines is a comprehensive suite of frameworks for reinforcement learning algorithm implementation, imitation… p-christ/deep-reinforcement-learning-algorithms-with-pytorch — This is a PyTorch-based toolkit for training reinforcement learning agents, providing implementations of standard and… andri27-ts/reinforcement-learning — This project is a collection of reinforcement learning implementations and educational materials written in Python. It… facebookresearch/horizon — Horizon is a reinforcement learning platform designed for training, evaluating, and deploying agents and contextual… lazyprogrammer/machine_learning_examples — This project is a comprehensive collection of practical code examples and implementation libraries for machine… morvanzhou/tutorials — This repository is a comprehensive collection of instructional guides and practical examples for Python development,…

Projects sharing features with Pytorch A2c Ppo Acktr Gail

These projects share indexed features with Pytorch A2c Ppo Acktr Gail. Shared tags can include platform or build tooling; verify the primary use case before treating a result as a replacement.
  • openai/baselinesopenai avatar

    openai/baselines

    16,733View on GitHub↗

    Baselines is a comprehensive suite of frameworks for reinforcement learning algorithm implementation, imitation learning, and training orchestration. It provides a library of standardized learning algorithms used to benchmark and replicate research results, alongside a deep learning policy framework for constructing neural network architectures such as multi-layer perceptrons, convolutional networks, and long short-term memory networks. The project includes a specialized imitation learning toolkit that enables agents to mimic expert behavior through behavior cloning and generative adversarial

    Python
    View on GitHub↗16,733
  • p-christ/deep-reinforcement-learning-algorithms-with-pytorchp-christ avatar

    p-christ/Deep-Reinforcement-Learning-Algorithms-with-PyTorch

    5,935View on GitHub↗

    This is a PyTorch-based toolkit for training reinforcement learning agents, providing implementations of standard and hierarchical deep RL algorithms. It is designed as a library for deep reinforcement learning research and experimentation, supporting both discrete and continuous control tasks through a collection of algorithm implementations. The project distinguishes itself by offering a hierarchical reinforcement learning framework that decomposes complex long-horizon tasks into manageable sub-goals using meta-controllers and lower-level policies. It also includes a Hindsight Experience Re

    Python
    View on GitHub↗5,935
  • andri27-ts/reinforcement-learningandri27-ts avatar

    andri27-ts/Reinforcement-Learning

    4,722View on GitHub↗

    This project is a collection of reinforcement learning implementations and educational materials written in Python. It provides neural network architectures for solving control tasks through deep reinforcement learning, spanning value-based and policy-gradient methods. The repository includes a library of evolutionary strategies and genetic algorithms as alternatives to gradient-based learning. It also features a model-based system for predicting future environment states and rewards to enable internal simulation and offline planning. The codebase covers a wide range of capabilities, includi

    Jupyter Notebooka2cartificial-intelligencedeep-learning
    View on GitHub↗4,722
  • facebookresearch/horizonfacebookresearch avatar

    facebookresearch/Horizon

    3,703View on GitHub↗

    Horizon is a reinforcement learning platform designed for training, evaluating, and deploying agents and contextual bandits using historical data. It serves as an off-policy engine and offline policy evaluation tool, allowing decision-making policies to be optimized and tested without the need for a live simulator. The framework specializes in recommendation system optimization, specifically using slating-based reinforcement learning to optimize the ordering and sequencing of multiple recommendations. It also functions as a contextual bandit framework that manages the balance between explorat

    Python
    View on GitHub↗3,703
  • Compare all 30 related projects→