Open-source alternatives to PufferLib

Skorch is a library that wraps PyTorch neural networks in a scikit-learn compatible interface, allowing deep learning models to be used within standard machine learning pipelines and hyperparameter optimization tools. It functions as a data adapter, training manager, and optimization tool that bridges the gap between deep learning modules and conventional machine learning workflows. The project distinguishes itself by providing a toolkit for automating the PyTorch training lifecycle, including integrated checkpointing, early stopping, and learning rate scheduling. It further enables transfer

Baselines is a comprehensive suite of frameworks for reinforcement learning algorithm implementation, imitation learning, and training orchestration. It provides a library of standardized learning algorithms used to benchmark and replicate research results, alongside a deep learning policy framework for constructing neural network architectures such as multi-layer perceptrons, convolutional networks, and long short-term memory networks. The project includes a specialized imitation learning toolkit that enables agents to mimic expert behavior through behavior cloning and generative adversarial

Dopamine is a reinforcement learning research framework designed for prototyping and testing algorithms across diverse simulated environments. It provides an agent development toolkit that utilizes a flat class hierarchy to facilitate the creation and extension of learning agents. The framework includes a standardization layer via environment wrappers that connect agents to various physics simulations and gaming environments. It also features a high-performance experience replay buffer for storing and sampling transition data to improve training stability, alongside a dedicated hyperparameter

This project is a reinforcement learning toolkit and simulation-based AI trainer for creating intelligent agents within Unity simulations. It provides a multi-agent simulation framework for configuring cooperative or competitive scenarios and includes an environment wrapper that bridges simulations with standard machine learning libraries using gym-style interfaces. The system features a native cross-platform inference engine that executes trained neural network models for real-time decision making without external dependencies. It enables the acceleration of the learning process by running m

Skorch is a deep learning workflow manager and tensor-based model interface. It provides a consistent API for training and predicting with neural networks within standard machine learning workflows, acting as a hyperparameter optimizer for finding optimal network configurations. The library specializes in wrapping PyTorch neural networks in a scikit-learn compatible interface. This allows tensor-based models to be used within traditional machine learning pipelines and grid search tools, including the mapping of parameter grids to model configurations. The framework covers training lifecycle

Nevergrad is a gradient-free optimization library and hyperparameter optimization framework designed to find the minimum of objective functions without using derivatives. It serves as an asynchronous optimization engine that decouples parameter suggestions from result reporting to support parallel function evaluations. The project specializes in multi-objective optimization to identify Pareto fronts for competing goals and provides a suite for benchmarking the performance and convergence of different optimization routines. It supports black-box system optimization, enabling the tuning of exte

The Arcade Learning Environment is a research-focused platform that provides a high-performance emulation engine for Atari 2600 games. It serves as a standardized environment for training and evaluating artificial intelligence agents, bridging native game execution with machine learning libraries through a dedicated Python interface. The project distinguishes itself by offering robust support for parallel and vectorized environment execution, allowing multiple game instances to run simultaneously to accelerate data collection. It includes specialized tools for asynchronous command queuing and

mctx is a framework for executing high-performance tree search and state simulations to generate policy targets for neural networks. It functions as a compiled search engine and neural dynamics simulator that predicts state transitions and rewards using learned representations. The project implements a vectorised tree search capable of running parallel search operations across input batches. It utilizes a policy target generator to convert search results into action weights used for training and refining neural network policies. The system covers reinforcement learning workflows by integrati

Open Spiel is a research library and framework for reinforcement learning, planning, and multi-agent game simulation. It provides a system for representing single-agent and multi-agent games across zero-sum, cooperative, and imperfect information scenarios. The project utilizes a standardized abstract game interface to decouple game logic from algorithms, allowing agents to run across different game types. It implements performance-critical logic in C++ with Python bindings and uses deterministic seeded simulation to ensure reproducibility for research benchmarking. The framework covers a br

Tensorlayer is a deep learning framework and cross-backend AI library used to construct and execute neural network models. It serves as a scientific neural network toolkit providing customizable layers and architectures designed for research applications in science and engineering. The library enables multi-backend model execution, allowing the same model code to run across different deep learning frameworks, GPUs, and specialized AI accelerators. It includes a reinforcement learning library that provides both low-level and high-level tools for developing intelligent agents.

This project is a comprehensive knowledge base and study resource designed for mastering technical interviews. It provides structured guides, roadmaps, and curricula focused on data structures, algorithms, system design, and frontend engineering to help candidates prepare for software engineering screenings. The repository distinguishes itself by offering a holistic approach to professional advancement. Beyond technical drills, it includes a career development handbook covering resume optimization, salary benchmarking, and strategic negotiation coaching. It also provides detailed methodologie

This project is a collection of structured study notes and notebooks serving as an educational resource for deep learning and neural network fundamentals. It provides a technical reference for implementing machine learning theory, covering everything from basic network design to the construction of advanced architectures. The material specifically focuses on the implementation of convolutional neural networks for computer vision and sequence models for natural language processing. It includes detailed guidance on building object detection systems, face recognition, and speech transcription mo

PyBoy is a programmable Game Boy emulator and hardware simulation framework written in Python. It functions as an emulation engine that allows users to execute original handheld software while providing a programmatic interface to control, probe, and automate game execution. The project is specifically designed as a reinforcement learning environment, exposing emulator states and controls to facilitate the training of machine learning agents. It distinguishes itself by providing tools for game area mapping and the extraction of simplified 2D screen representations and collision maps to suppor

This project is a collection of comprehensive guides and reference materials designed for technical interviews, machine learning system design, and professional development. It serves as a technical knowledge base and a career coaching manual, providing structured resources to help candidates navigate the machine learning hiring landscape. The resource distinguishes itself by offering detailed frameworks for comparing industry roles, analyzing company types, and planning long-term career progression. It provides specific guidance on evaluating employer organizational health, identifying resea

Lab is a customizable 3D platform and research testbed designed for training and testing autonomous agents using reinforcement learning. It serves as a spatial AI training simulator where agents can be evaluated through navigation and puzzle-solving tasks. The environment allows for the definition of complex layouts and task behaviors through external scripting, enabling the generation of specific challenges for AI research. It supports both automated training via standard API bindings and manual agent control to validate simulation dynamics. The system utilizes a grid-based spatial represen

This project is a collection of pretrained reinforcement learning agents and training scripts built on Stable Baselines3 and Gymnasium. It provides a framework for training agents to solve specific tasks, managing experiment reproducibility, and deploying pretrained models. The system includes a specialized benchmarking suite and optimization tools for tuning agent settings. It utilizes automated search spaces and distributed trials to maximize performance, while employing bootstrap sampling to generate statistically robust performance metrics and confidence intervals. Broad capabilities cov

TinyZero is a reinforcement learning framework and implementation designed to train language models to develop reasoning and self-verification abilities. It provides a training pipeline to optimize model performance on mathematical and logical tasks. The project serves as a minimal reproduction of the DeepSeek R1 architectural and training approach. It focuses on creating reasoning models that can solve structured problems through autonomous chain-of-thought discovery. The framework incorporates group relative policy optimization and reward-based self-correction to improve accuracy on logica

This project is a machine learning educational curriculum and learning platform delivered through interactive Jupyter Notebooks. It serves as a comprehensive guide for mastering the Python data science toolkit, providing structured tutorials for numerical computing, tabular data manipulation, and statistical visualization. The curriculum includes specific implementation guides for Scikit-Learn and a practical course on TensorFlow for constructing, training, and deploying neural networks and computer vision models. It covers the end-to-end process of building predictive models, from initial pr

Newton is a GPU-accelerated physics engine and robotics simulation platform designed for high-performance modeling of rigid bodies and complex articulations. It functions as a differentiable physics engine, calculating gradients to enable mathematical optimization and machine learning. The platform is distinguished by its ability to execute multiple parallel physics worlds on a single GPU, which accelerates data collection for reinforcement learning. It also supports the simulation of deformable bodies, such as cloth and cables, using particle-based methods and multi-physics coupling. Newton

Video-Pre-Training is a machine learning framework designed for training autonomous agents to perform complex tasks by observing and mimicking human behavior from video recordings. It provides a comprehensive toolkit for imitation learning and reinforcement learning research, enabling the development of agents that can replicate human actions within simulated digital environments. The framework distinguishes itself through its ability to process large-scale, unlabeled video datasets to bootstrap agent capabilities. It utilizes inverse dynamics modeling to infer control inputs from frame trans

This project is a collection of interactive graphical tools designed for monitoring neural network training, latent space mappings, and the internal mechanisms of transformers. It functions as a visual learning environment for understanding how large language models process tokens and an educational tool for analyzing the interactions between generators and discriminators within adversarial networks. The system provides a browser-based transformer architecture visualizer to show the mathematical operations used for token prediction in real time. It also includes a generative adversarial netwo

This project is an educational resource providing practical code examples and implementations of machine learning algorithms using the Python language. It serves as a guide for constructing predictive pipelines, clustering models, and dimensionality reduction within the Scikit-Learn ecosystem. The repository includes comprehensive demonstrations for supervised and unsupervised learning, as well as detailed examples for implementing neural networks and deep architectures. It also provides practical guidance on exporting model parameters to JSON and wrapping trained models in web APIs for produ

This project is a reinforcement learning framework and game AI engine designed for training adversarial agents in two-player turn-based games. It implements a training loop that utilizes self-play and Monte Carlo Tree Search to produce neural networks capable of predicting board strength and move probabilities. The system decouples the reinforcement learning engine from specific game rules through an abstract game logic interface, allowing for the definition of custom game rules, win conditions, and board representations. It supports integration with various deep learning frameworks to serve

Tinker Cookbook is an open-source framework for fine-tuning large language models, supporting supervised learning, reinforcement learning, and parameter-efficient techniques like LoRA adapters. It provides a complete pipeline for aligning models with human preferences through multi-stage RLHF workflows, from supervised fine-tuning through preference optimization to reinforcement learning. The framework distinguishes itself through recipe-based training orchestration, where fine-tuning workflows are defined as composable recipe files that chain data loading, model configuration, and training l

This project provides a comprehensive technical guide and framework for engineering large-scale machine learning systems. It covers the full lifecycle of model development, focusing on the infrastructure and computational principles required to build, train, and serve generative AI models across distributed GPU clusters. The repository distinguishes itself by offering deep-dive tutorials and implementation strategies for complex system challenges. It emphasizes high-performance architectural primitives, such as collective communication orchestration, distributed tensor sharding, and static gr

This is a real-time object detection framework built on the YOLOv3 architecture, implemented in PyTorch. It provides a complete pipeline for identifying and localizing objects in images and video using a single neural network pass, combining a Darknet-53 backbone with multi-scale feature pyramids and anchor-based bounding box prediction. The framework extends beyond basic detection to include instance segmentation, human pose estimation, and multi-object tracking across video frames. It offers a model export toolkit that converts trained models through ONNX to CoreML, TensorFlow Lite, and Ten