Sentdex/pygta5
Pygta5
pygta5 est une bibliothèque d'automatisation de jeu Python conçue pour contrôler les actions et simuler l'entrée du joueur au sein de Grand Theft Auto 5. Elle sert de framework pour collecter des données de jeu, traiter des images visuelles via des réseaux de neurones et automatiser le gameplay via le deep learning.
Le projet implémente un contrôleur de réseau de neurones convolutif pour faire des prédictions de conduite et de mouvement en temps réel basées sur des images de jeu visuelles. Il utilise des modèles de régression et le deep learning pour exécuter des actions autonomes, permettant la création d'agents autonomes capables de contrôler des personnages ou des véhicules.
Le système inclut des capacités pour rassembler et équilibrer des échantillons de jeux de données pour le machine learning supervisé. Il prend en charge en outre la vision par ordinateur multi-caméra pour traiter des flux visuels simultanés pour l'inférence IA et la surveillance à distance de la progression de l'entraînement du machine learning via un serveur central.
Features
- Autonomous Game Agents - Trains autonomous agents to control characters and vehicles by analyzing visual game input.
- Gameplay Automation Libraries - Provides a set of tools for controlling game actions and simulating player input within Grand Theft Auto 5 using Python.
- Visual Control Systems - Implements a system that processes visual game frames via neural networks to predict real-time driving and movement.
- Game Automation Bots - Implements AI agents that utilize deep learning to automate complex gameplay mechanics and actions.
- Game Data Collection Frameworks - Provides a framework for gathering and balancing dataset samples from game instances for model training.
- CNN Architectures - Uses convolutional neural network architectures to process visual game frames for movement predictions.
- Game Input Automation - Uses Python scripts to simulate human-like keyboard and mouse interactions for game automation.
- Gameplay Automation - Provides scripts and tools to automate repetitive tasks and player movements within a video game.
- Real-Time Model Inference on Frames - Runs convolutional neural networks on live game frames for real-time driving and action predictions.
- Autonomous Navigation - Controls vehicle driving by processing visual input through a convolutional neural network to generate predictions.
- Model-Based Control - Utilizes regression models and real-time training to control vehicle movement within a game.
- Game Input Simulation - Simulates keyboard and controller interactions to programmatically manipulate the game environment.
- Dataset Sampling Utilities - Captures and balances game state and user action samples to create datasets for supervised learning.
- General Regression Models - Uses regression algorithms to map game state inputs to continuous control values for driving.
- Training Dataset Collection - Captures and saves raw environment images and game states to create training datasets.
- Streaming Training Management - Provides a system for managing the streaming of model updates and training progress via a central server.
- Model Weight Synchronization - Synchronizes model weights and training progress between local game instances and a remote server.
- Multi-Camera Vision Pipelines - Integrates multiple synchronized camera streams to provide AI inference and cinematic perspectives.
- Multi-Perspective Aggregation - Processes simultaneous visual data from multiple in-game cameras for comprehensive AI inference.
