Abstract:The expansion of underwater scenarios and missions highlights the crucial need for autonomous underwater vehicles (AUVs) to make informed decisions. Therefore, developing an efficient decision-making framework is vital to enhance productivity in executing complex tasks within tight time constraints. This paper delves into task planning and reconstruction within the AUV control decision system to enable intelligent completion of intricate underwater tasks. Behavior trees (BTs) offer a structured approach to organizing the switching structure of a hybrid dynamical system (HDS), originally introduced in the computer game programming community. In this research, an intelligent search algorithm, MCTS-QPSO (Monte Carlo tree search and quantum particle swarm optimization), is proposed to bolster the AUV's capacity in planning complex task decision control systems. This algorithm tackles the issue of the time-consuming manual design of control systems by effectively integrating BTs. By assessing a predefined set of subtasks and actions in tandem with the complex task scenario, a reward function is formulated for MCTS to pinpoint the optimal subtree set. The QPSO algorithm is then leveraged for subtree integration, treating it as an optimal path search problem from the root node to the leaf node. This process optimizes the search subtree, thereby enhancing the robustness and security of the control architecture. To expedite search speed and algorithm convergence, this paper recommends reducing the search space by pre-grouping conditions and states within the behavior tree. The efficacy and superiority of the proposed algorithm are validated through security and timeliness evaluations of the BT, along with comparisons with other algorithms for automatic AUV decision control behavior tree design. Ultimately, the effectiveness and superiority of the proposed algorithm are corroborated through simulations on a multi-AUV complex task platform, showcasing its practical applicability and efficiency in real-world underwater scenarios.

A Collaborative Decision Making Approach for Multi-Unmanned Combat Vehicles Based on the Behaviour Tree

Enhancing Autonomous Underwater Vehicle Decision Making through Intelligent Task Planning and Behavior Tree Optimization

Autonomous attack decision-making of UCAV based on ABFCM model framework

Manoeuvre Decision‐making of Unmanned Aerial Vehicles in Air Combat Based on an Expert Actor‐based Soft Actor Critic Algorithm

Limited Intervention Collaborative Decision Making of MAV-UAV Team Based on VFCM

Decision-Making Method for Space-Based Combat Based on Hierarchical Structure Varied Discrete Dynamic Bayesian Network

Collaborative Decision-making in Heterogeneous UAV Swarms Based on Multi-agent Deep Reinforcement Learning

Human-Robot Collaborative Decision Method of Hexapod Robot Based on Prior Knowledge and Negotiation Strategy

Automated Maneuvering Decision for UAVs in Forest Surveillance and Fire Detection Missions

A Behavior Decision Method for Autonomous Vehicles in an Urban Scene.

Self-play Decision-making Method of Deep Reinforcement Learning Guided by Behavior Tree under Complex Environment

UAV Cooperative Air Combat Maneuvering Confrontation Based on Multi-agent Reinforcement Learning

Towards Realizing Intelligent Coordinated Controllers for Multi-USV Systems Using Abstract Training Environments

Task Management for Autonomous Flights of Micro Aerial Vehicles: A Behavior Tree Approach

Multi-UAV Cooperative Swarm Algorithm in Air Combat Based on Predictive Game Tree

Research and Effectiveness Analysis of Intelligent Unmanned Equipment Group Collaboration in Combat Simulation System

Airborne Multi-Sensor Management Methods Based on Fuzzy Decision Tree

Autonomous Maneuver Decision for Unmanned Fighters in Multi-Agent BVR Air Combat

Cooperative Maneuver Decision Making for Multi-Uav Air Combat Based on Incomplete Information Dynamic Game

Game of Drones: Intelligent Online Decision Making of Multi-UAV Confrontation

UAV cooperative air combat maneuver decision based on multi-agent reinforcement learning