Abstract:The expansion of underwater scenarios and missions highlights the crucial need for autonomous underwater vehicles (AUVs) to make informed decisions. Therefore, developing an efficient decision-making framework is vital to enhance productivity in executing complex tasks within tight time constraints. This paper delves into task planning and reconstruction within the AUV control decision system to enable intelligent completion of intricate underwater tasks. Behavior trees (BTs) offer a structured approach to organizing the switching structure of a hybrid dynamical system (HDS), originally introduced in the computer game programming community. In this research, an intelligent search algorithm, MCTS-QPSO (Monte Carlo tree search and quantum particle swarm optimization), is proposed to bolster the AUV's capacity in planning complex task decision control systems. This algorithm tackles the issue of the time-consuming manual design of control systems by effectively integrating BTs. By assessing a predefined set of subtasks and actions in tandem with the complex task scenario, a reward function is formulated for MCTS to pinpoint the optimal subtree set. The QPSO algorithm is then leveraged for subtree integration, treating it as an optimal path search problem from the root node to the leaf node. This process optimizes the search subtree, thereby enhancing the robustness and security of the control architecture. To expedite search speed and algorithm convergence, this paper recommends reducing the search space by pre-grouping conditions and states within the behavior tree. The efficacy and superiority of the proposed algorithm are validated through security and timeliness evaluations of the BT, along with comparisons with other algorithms for automatic AUV decision control behavior tree design. Ultimately, the effectiveness and superiority of the proposed algorithm are corroborated through simulations on a multi-AUV complex task platform, showcasing its practical applicability and efficiency in real-world underwater scenarios.

Attacking Decision of Underwater Multiple Targets by Using Analytic Network Process (ANP)

Coordinated Target Localization and Tracking with Node Scheduling for a Network of Autonomous Underwater Vehicles

An Unmanned Underwater Vehicle Torpedoes Attack Behavior Autonomous Decision-Making Method Based on Model Fusion

Underwater Target Threat Assessment Method Based on Bayesian Network

Research on Multiple-AUVs Collaborative Detection and Surrounding Attack Simulation

Adaptive Dynamic Programming Based on Parallel Control Theory for Underwater Vehicles.

Multi-AUV Cooperative Underwater Multi-Target Tracking Based on Dynamic-Switching-enabled Multi-Agent Reinforcement Learning

HA-MARL: Heuristic and APF Assisted Multi-Agent Reinforcement Learning for Wireless Data Sharing in AUV Swarms

Enhancing Autonomous Underwater Vehicle Decision Making through Intelligent Task Planning and Behavior Tree Optimization

Research on Real Time Obstacle Avoidance Method for AUV Based on Combination of ViT-DPFN and MPC

Research on Cooperative Attack Decision of Unmanned Combat Aerial Vehicles Using Self-Adaptive Grey Wolf Optimization

Multi-AUV underwater static target search method based on consensus-based bundle algorithm and improved glasius bio-inspired neural network

Multi-AUV Cooperative Target Hunting Based on Improved Potential Field in Underwater Environment

Current Effect-eliminated Optimal Target Assignment and Motion Planning for a Multi-UUV System

An Effective Strategy for Distributed Unmanned Underwater Vehicles to Encircle and Capture Intelligent Targets

Adversarial Decision Making Against Intelligent Targets in Cooperative Multi-agent Systems

Adversarial Decision Making Against Intelligent Targets in Cooperative Multiagent Systems

UAV Cooperative Air Combat Maneuvering Confrontation Based on Multi-agent Reinforcement Learning

Smart Underwater Pollution Detection Based on Graph-Based Multi-Agent Reinforcement Learning Towards AUV-Based Network ITS

A fuzzy-based potential field hierarchical reinforcement learning approach for target hunting by multi-AUV in 3-D underwater environments