7 个仓库
Standardized implementations of learning algorithms designed for consistent research replication and comparison.
Distinct from Algorithm Implementations: Focuses on the standardization of RL APIs for benchmarking, not pedagogical implementations.
Explore 7 awesome GitHub repositories matching artificial intelligence & ml · Algorithm Benchmarking Libraries. Refine with filters or upvote what's useful.
Baselines is a comprehensive suite of frameworks for reinforcement learning algorithm implementation, imitation learning, and training orchestration. It provides a library of standardized learning algorithms used to benchmark and replicate research results, alongside a deep learning policy framework for constructing neural network architectures such as multi-layer perceptrons, convolutional networks, and long short-term memory networks. The project includes a specialized imitation learning toolkit that enables agents to mimic expert behavior through behavior cloning and generative adversarial
Provides a library of standardized learning algorithms used to benchmark and replicate research results.
该项目是一个用于 PyTorch 的计算机视觉可解释 AI 库和框架,提供了一套工具来可视化和审计深度神经网络的内部决策过程。它作为一个神经网络归因工具和调试实用程序,用于识别哪些图像区域驱动了模型预测。 该库以其对基于梯度和无梯度归因方法的支持而著称,允许在无需修改原始模型源代码的情况下生成视觉热力图和归因图。它通过视觉概念发现进一步脱颖而出,使用矩阵分解将内部激活分解为可解释的模式,并将潜在嵌入映射到像素重要性。 该框架涵盖了广泛的能力,包括热力图生成和细化、针对视觉 Transformer 等架构的空间转换,以及针对目标检测和语义分割等多任务视觉目标的适配。它还包括一个模型保真度评估套件,采用扰动分析、消融研究和定位测量来量化生成解释的忠实度。 该项目提供了用于动态激活钩子、自定义架构适配和目标驱动目标配置的机制,以将可解释性工具连接到各种模型输出。
Benchmarks various attribution algorithms like GradCAM and ScoreCAM to evaluate their reliability and performance.
Captum is an open-source library for explaining model predictions by attributing them to input features, neurons, and layers using gradient-based and perturbation-based methods. It provides a modular framework for implementing, evaluating, and combining a range of explanation techniques, including gradient-based attribution, perturbation-based analysis, game-theoretic Shapley value approximation, and surrogate model explanations, with support for parallelization and noise stabilization. The library distinguishes itself through its breadth of attribution methods and its support for advanced in
Compares and evaluates custom interpretability methods against built-in attribution algorithms for reliability and performance.
本项目是一个 PyTorch 强化学习库和智能体训练框架。它提供了一套深度强化学习算法,包括 DQN、PPO 和 SAC,以促进通过试错法优化行为的自主智能体开发。 该库专注于实现各种 Actor-Critic 方法和深度学习架构,用于自主决策研究。它通过利用基于 PyTorch 的模型实现,支持在不同环境中训练智能智能体。 该代码库涵盖了核心强化学习功能,包括策略梯度优化、经验回放缓冲区和目标网络解耦。它还支持多工作进程异步训练和随机策略采样,以管理智能体收敛和环境探索。
Provides a suite of deep RL implementations including DQN, PPO, and SAC for autonomous decision research.
Acme 是一个强化学习框架和执行引擎,旨在开发和基准测试学习算法。它提供了一个模块化组件库和参考实现,用于构建智能体并建立性能基准。 该系统支持将智能体架构从单流执行扩展到大规模分布式环境。这使得从初步原型设计到用于训练和评估的分布式执行的过渡变得更加顺畅。 该框架涵盖了强化学习开发和智能体架构原型设计,提供了将新模型与标准参考智能体进行基准测试所需的构建模块。
Implements toolkits for benchmarking new reinforcement learning algorithms against standard reference agents.
RLcard is an open-source framework for developing and evaluating reinforcement learning agents across multiple card game environments. It functions as a card game environment simulator, a multi-agent RL platform, and a benchmarking toolkit for algorithms like DQN, NFSP, and CFR. The framework provides a game-agnostic environment interface that decouples agent logic from game mechanics, allowing any policy to interact through a common API. It supports pluggable reinforcement learning algorithms that operate on this interface without modifying game logic, and includes a self-play training loop
A toolkit for benchmarking reinforcement learning algorithms like DQN, NFSP, and CFR across standardized card game tasks.
This project is a collection of pretrained reinforcement learning agents and training scripts built on Stable Baselines3 and Gymnasium. It provides a framework for training agents to solve specific tasks, managing experiment reproducibility, and deploying pretrained models. The system includes a specialized benchmarking suite and optimization tools for tuning agent settings. It utilizes automated search spaces and distributed trials to maximize performance, while employing bootstrap sampling to generate statistically robust performance metrics and confidence intervals. Broad capabilities cov
Ships a specialized benchmarking suite for evaluating RL agent success using statistically robust metrics.