Sentdex/pygta5
Pygta5
pygta5 ist eine Python-Spielautomatisierungsbibliothek, die darauf ausgelegt ist, Aktionen zu steuern und Spielereingaben innerhalb von Grand Theft Auto 5 zu simulieren. Sie dient als Framework für das Sammeln von Spieldaten, die Verarbeitung visueller Frames mittels neuronaler Netzwerke und die Automatisierung des Gameplays durch Deep Learning.
Das Projekt implementiert einen Convolutional-Neural-Network-Controller, um Echtzeit-Fahr- und Bewegungs-Vorhersagen basierend auf visuellen Spielframes zu treffen. Es nutzt Regressionsmodelle und Deep Learning, um autonome Aktionen auszuführen, was die Erstellung autonomer Agenten ermöglicht, die Charaktere oder Fahrzeuge steuern können.
Das System umfasst Funktionen für das Sammeln und Ausbalancieren von Datensatz-Stichproben für überwachtes Machine Learning. Es unterstützt zudem Multi-Kamera-Computer-Vision, um gleichzeitige visuelle Feeds für KI-Inferenz zu verarbeiten, sowie die Remote-Überwachung des Fortschritts beim Machine-Learning-Training über einen zentralen Server.
Features
- Autonomous Game Agents - Trains autonomous agents to control characters and vehicles by analyzing visual game input.
- Gameplay Automation Libraries - Provides a set of tools for controlling game actions and simulating player input within Grand Theft Auto 5 using Python.
- Visual Control Systems - Implements a system that processes visual game frames via neural networks to predict real-time driving and movement.
- Game Automation Bots - Implements AI agents that utilize deep learning to automate complex gameplay mechanics and actions.
- Game Data Collection Frameworks - Provides a framework for gathering and balancing dataset samples from game instances for model training.
- CNN Architectures - Uses convolutional neural network architectures to process visual game frames for movement predictions.
- Game Input Automation - Uses Python scripts to simulate human-like keyboard and mouse interactions for game automation.
- Gameplay Automation - Provides scripts and tools to automate repetitive tasks and player movements within a video game.
- Real-Time Model Inference on Frames - Runs convolutional neural networks on live game frames for real-time driving and action predictions.
- Autonomous Navigation - Controls vehicle driving by processing visual input through a convolutional neural network to generate predictions.
- Model-Based Control - Utilizes regression models and real-time training to control vehicle movement within a game.
- Game Input Simulation - Simulates keyboard and controller interactions to programmatically manipulate the game environment.
- Dataset Sampling Utilities - Captures and balances game state and user action samples to create datasets for supervised learning.
- General Regression Models - Uses regression algorithms to map game state inputs to continuous control values for driving.
- Training Dataset Collection - Captures and saves raw environment images and game states to create training datasets.
- Streaming Training Management - Provides a system for managing the streaming of model updates and training progress via a central server.
- Model Weight Synchronization - Synchronizes model weights and training progress between local game instances and a remote server.
- Multi-Camera Vision Pipelines - Integrates multiple synchronized camera streams to provide AI inference and cinematic perspectives.
- Multi-Perspective Aggregation - Processes simultaneous visual data from multiple in-game cameras for comprehensive AI inference.
