LmeSzinc/AzurLaneAutoScript
AzurLaneAutoScript
AzurLaneAutoScript is a mobile game automation system designed to perform repetitive gameplay tasks unattended. It functions as a screenshot-driven bot that controls Android devices, emulators, and cloud phones via ADB and uiautomator2, using computer vision to make interaction decisions instead of fixed timers.
The project distinguishes itself through an advanced computer vision suite that includes local optical character recognition and perspective-aware grid detection. These tools allow the bot to parse 3D game maps, compute vanishing points, and normalize grid-centered objects for precise entity identification.
The system covers a broad range of operational capabilities, including the automation of combat missions, daily routines, resource harvesting, and fleet management. It features a centralized task scheduler to coordinate independent jobs and can be deployed as a cross-platform Electron desktop application, a web-based remote controller, or a headless Docker container.
The software supports a variety of environments, including ARM-based hardware, single-board computers, and multiple Android emulator distributions.
Features
- ADB Device Managers - Uses ADB and uiautomator2 to send touch inputs and read screen states for Android device control.
- Game Automation Bots - Implements an autonomous bot that reads game state and executes gameplay actions without manual input.
- Gameplay Automation - Provides a graphical interface that handles combat, resource collection, and daily tasks automatically.
- Computer Vision - Applies computer vision systems to analyze screen captures and identify game elements for interaction.
- Screen Text Extractors - Recognizes on-screen text and digits using OCR models specifically trained for game fonts.
- Visual Action Triggers - Triggers programmatic automation actions based on image matching and OCR detections in real-time.
- Game Map Analysis - Extracts layout and sector information from game screens to track unit positions and avoid obstacles.
- Template-Based Object Matching - Identifies game entities by comparing normalized image crops against known template images.
- Visual Entity Identification - Combines perspective and grid parsing to determine the precise screen locations of units and enemies.
- Automation Control Panels - Provides a graphical interface to start, stop, and monitor the automation process.
- Text Extraction and OCR - Converts screen pixels into usable text data using specialized OCR models for decision-making.
- Optical Character Recognitions - Uses local optical character recognition to extract text from game screenshots for decision-making.
- Game Mode Schedulers - The bot coordinates game automation via a task scheduler to manage timing and operational modes.
- Screen Capture and Text Extraction - Captures screen regions and extracts numeric or character text using a local OCR model.
- Sequential Job Queues - The bot enqueues multiple missions and configures their specific settings to run sequentially.
- Task Scheduling - Implements a centralized scheduler that automates gameplay routines based on recurring intervals and completion status for unattended operation.
- Automation Job Coordination - The bot queues multiple independent automation tasks and calculates optimal start times to ensure continuous operation.
- Task Schedulers - The bot enables or disables specific tasks within the settings to initiate or stop automated routines.
- Sequential Execution Flows - The bot manages independent tasks with a central scheduler that reschedules jobs immediately after completion.
- Battles and Daily Routine Automators - Automates daily missions and event-based recurring tasks without manual intervention.
- Battle Grid Analysis - Reads the in-game battle grid to identify enemy positions and obstacles for automated combat.
- Mobile Game Automation Tools - Automates repetitive mobile game loops including combat, resource collection, and daily tasks.
- Grid Perspective Detection - Identifies perspective grids in game maps by fitting vanishing points to align cells.
- AI-Driven Action Loops - Implements a screenshot-driven loop that captures the screen and executes actions based on visual triggers.
- Screen Map Data Extraction - Extracts map information and entity locations by processing raw screen content.
- Android Device Controllers - Controls Android devices via ADB and uiautomator2 to automate gameplay interactions.
- Cooldown-Constrained Scheduling - Coordinates gameplay routines using a centralized scheduler that manages task cooldowns and timing.
- Gameplay Cycle Automators - Automates recurring daily, weekly, and monthly game loops, including shop purchases and resets.
- Computer Vision Screen Interaction Tools - Employs OCR and template matching to identify visual elements and make interaction decisions.
- Screen Entity Normalization - Normalizes images of grid-centered objects to enable precise template matching of ships and enemies.
- Android Device Integrations - Integrates with physical devices, emulators, and cloud phones for high-performance automation.
- Map Layout Analysis - Generates a comprehensive grid of area information from screenshots to locate game targets accurately.
- Vanishing Point Detection - Computes the vanishing point of perspective lines to normalize 3D game map views.
- Automation Parameter Management - Provides a graphical interface to adjust game-specific parameters and bot behavior.
- In-Game Commission Automation - Checks for available in-game commissions and dispatches fleets without manual intervention.
- Visual Feature Normalization - Crops and scales images around grid centers to a uniform size for reliable template matching.
- Emulator-Specific Integrations - Includes a specialized connector for BlueStacks with ADB debugging enabled.
- Wait-State Looping - The bot waits for timed operations and background research to complete before resuming active operations.
- Automation Sequences - The bot activates multiple gameplay tasks and manages their execution sequence through an automated scheduler.
- Task Schedulers - The bot coordinates multiple independent automation jobs through a centralized scheduler that manages timing and priorities.
- Automation Task Timelines - The bot manages a precise timeline of diverse game activities to optimize resource gathering and progression.
- Cloud Phone Integrations - Supports running the bot on a cloud server while the game executes on a remote cloud phone.
- Docker Container Deployments - Provides a Docker container image for persistent, headless operation of the automation bot.
- Containerized Application Deployments - Packages the application into Docker containers for persistent, headless operation without a desktop environment.
- Containerized Deployments - Packages the automation bot into Docker containers for persistent, headless operation on servers.
- Containerized Server Deployments - Packages the automation bot into Docker containers for persistent, headless server operation.
- Combat Stage Automators - Replays time-limited event maps automatically to collect currency and rewards.
- Complex Mission Logic - Handles complex map mechanisms and puzzles during story and event mission execution.
- Game Resource Farming - Automates main chapters and raids using specialized farming routes to gather resources.
- Emulator Connection Settings - Allows specifying serial numbers, clients, and regions to connect to devices or emulators.
- Cooldown-Aware - The bot manages multiple independent jobs through a central scheduler that enforces cooldown periods.
- Morale Management Systems - The bot manages ship morale to prevent penalties by scheduling actions around recovery times.
- Containerized Bot Deployments - Enables persistent, headless operation of the automation bot inside a Docker container.
- Screen-State Triggering - Launches automation routines only from specific in-game screens to ensure reliable navigation.
- Gameplay Routine Schedulers - Executes repetitive tasks and daily missions based on a predefined automation schedule.
- Resource Collection - Tracks completion times of timed activities to harvest resources immediately.
- Automated Reward Collections - Automatically gathers rewards from commissions, research, and shops.
- Map Navigation Automations - Autonomously traverses game maps while handling movement restrictions and puzzles.
- Open-World Exploration - Automates the exploration of open world zones, including fortress clearing and monthly resets.
- Exploration Workflows - Sequences monthly exploration, daily tasks, and boss fights into a single automated open-world pipeline.
- Remote Bot Controllers - Exposes the bot interface on a local port for remote access and control from other devices.
- Resource Gathering Automation - Implements an automated system for gathering resources from research, dorms, and shops.
- Unit Attribute Recovery Systems - The bot calculates morale consumption and pauses fleets to maintain experience bonuses.
- Game Map Analysis - Analyzes full sea chart layouts to provide critical grid information for automated pathfinding.
- Grid Line Detection - Identifies vertical and horizontal grid lines on a map by detecting pixel peaks.
- Perspective-Aware Cell Cropping - Implements perspective-aware cropping to extract normalized images from grid cells for accurate template matching.
- Perspective Cell Extraction - Extracts and scales images from grid cells based on perspective for template matching.
- Vanishing Point Estimation - Locates the horizon point to minimize the spread of diagonal grid intersections for accurate map parsing.
- Game Grid Analysis - Processes sea map grids to identify enemy positions and determine optimal navigation routes.
- macOS ARM Support - Supports execution on ARM-based Mac hardware via compatible emulators.
- Emulator-Specific Integrations - Includes integration for Nox emulator on supported hardware.
- Single Board Computer Deployments - Enables the bot to run on ARM-based single-board computers using specialized Linux environments.
- Web-Based Remote Clients - Provides a local web server with a browser interface for remote management of the automation process.
- Emulator Display & ADB Settings - Manages emulator resolution and ADB settings to ensure stable communication.
- Emulation Session Control - Manages the starting and restarting of emulators to maintain automation stability.
- macOS x86 Support - Supports execution on Intel-based Mac hardware using virtual devices.
- Tethered Device Operations - Supports controlling a physically tethered Android phone from a host PC using ADB.
- Automation Job Dispatchers - The bot schedules and executes multiple routines simultaneously via an automated dispatcher.
- Game Mission Automations - Automatically completes main story and event missions to farm gems and other resources.
- Remote Management - The bot exposes a web server to manage application settings from a remote browser.
- Remote Monitoring Dashboards - The bot serves a browser-based interface for monitoring and controlling automation remotely.
- Emulator-Specific Integrations - Links the automation software to specific emulator instances using serial identifiers.
- Desktop Application Interfaces - Ships a cross-platform Electron-based desktop application for configuring and monitoring the bot.
- Image-Based - Uses image-based regions instead of static coordinates to identify screen elements across different servers.
- Resolution-Aware Asset Mapping - Maps screen coordinates to image files to define interactive regions across different device resolutions.
- Game Management Interfaces - Ships a cross-platform Electron desktop application for configuring and monitoring automated game tasks.
- Cross-Platform Desktop Applications - Provides a cross-platform Electron application with a native graphical interface for managing automation.
