Abstract:The expansion of underwater scenarios and missions highlights the crucial need for autonomous underwater vehicles (AUVs) to make informed decisions. Therefore, developing an efficient decision-making framework is vital to enhance productivity in executing complex tasks within tight time constraints. This paper delves into task planning and reconstruction within the AUV control decision system to enable intelligent completion of intricate underwater tasks. Behavior trees (BTs) offer a structured approach to organizing the switching structure of a hybrid dynamical system (HDS), originally introduced in the computer game programming community. In this research, an intelligent search algorithm, MCTS-QPSO (Monte Carlo tree search and quantum particle swarm optimization), is proposed to bolster the AUV's capacity in planning complex task decision control systems. This algorithm tackles the issue of the time-consuming manual design of control systems by effectively integrating BTs. By assessing a predefined set of subtasks and actions in tandem with the complex task scenario, a reward function is formulated for MCTS to pinpoint the optimal subtree set. The QPSO algorithm is then leveraged for subtree integration, treating it as an optimal path search problem from the root node to the leaf node. This process optimizes the search subtree, thereby enhancing the robustness and security of the control architecture. To expedite search speed and algorithm convergence, this paper recommends reducing the search space by pre-grouping conditions and states within the behavior tree. The efficacy and superiority of the proposed algorithm are validated through security and timeliness evaluations of the BT, along with comparisons with other algorithms for automatic AUV decision control behavior tree design. Ultimately, the effectiveness and superiority of the proposed algorithm are corroborated through simulations on a multi-AUV complex task platform, showcasing its practical applicability and efficiency in real-world underwater scenarios.

Multi-UUV Cooperative Dynamic Maneuver Decision-Making Algorithm Using Intuitionistic Fuzzy Game Theory

MULTI-AUV DYNAMIC MANEUVER DECISION-MAKING BASED ON INTUITIONISTIC FUZZY COUNTER-GAME AND FRACTIONAL-ORDER PARTICLE SWARM OPTIMIZATION

Multi-UUV Maneuvering Counter-Game for Dynamic Target Scenario Based on Fractional-Order Recurrent Neural Network

Multi-AUV Dynamic Maneuver Countermeasure Algorithm Based on Interval Information Game and Fractional-Order DE

Multi-Autonomous Underwater Vehicle Full-Coverage Path-Planning Algorithm Based on Intuitive Fuzzy Decision-Making

Cooperative Maneuver Decision Making for Multi-Uav Air Combat Based on Incomplete Information Dynamic Game

Optimizing Underwater Game Strategy Based on Cooperative Confrontation

Multi-UAV Counter-Game Model Based on Uncertain Information

Efficiency Evaluation of Multi-UUVs Coordinated Operation Based on Underwater Network

UUV Autonomous Decision-Making Method Based on Dynamic Influence Diagram

Collaborative task decision-making of multi-UUV in dynamic environments based on deep reinforcement learning

An Effective Strategy for Distributed Unmanned Underwater Vehicles to Encircle and Capture Intelligent Targets

AUV Antagonistic Tactics Study for Naval Battle Based on Dynamic Game.

APPLICATION OF EXTENDED GAME IN MULTI-UUV PURSUIT-ESCAPE TASK

Game Decision of Multi-UAV Based on Improved Shark Smell Optimization Algorithm

HA-MARL: Heuristic and APF Assisted Multi-Agent Reinforcement Learning for Wireless Data Sharing in AUV Swarms

Enhancing Autonomous Underwater Vehicle Decision Making through Intelligent Task Planning and Behavior Tree Optimization

Deep Reinforcement Learning Based Multi-Auvs Cooperative Decision-Making for Attack–defense Confrontation Missions

Robust Optimization based Air Combat Game Decision-making of Multi-UAV with Uncertain Information

A Cooperative Hunting Method for Multi-AUV Swarm in Underwater Weak Information Environment with Obstacles

A Game-Based Decision-Making Method for Multi-Ship Collaborative Collision Avoidance Reflecting Risk Attitudes in Open Waters