Abstract:The expansion of underwater scenarios and missions highlights the crucial need for autonomous underwater vehicles (AUVs) to make informed decisions. Therefore, developing an efficient decision-making framework is vital to enhance productivity in executing complex tasks within tight time constraints. This paper delves into task planning and reconstruction within the AUV control decision system to enable intelligent completion of intricate underwater tasks. Behavior trees (BTs) offer a structured approach to organizing the switching structure of a hybrid dynamical system (HDS), originally introduced in the computer game programming community. In this research, an intelligent search algorithm, MCTS-QPSO (Monte Carlo tree search and quantum particle swarm optimization), is proposed to bolster the AUV's capacity in planning complex task decision control systems. This algorithm tackles the issue of the time-consuming manual design of control systems by effectively integrating BTs. By assessing a predefined set of subtasks and actions in tandem with the complex task scenario, a reward function is formulated for MCTS to pinpoint the optimal subtree set. The QPSO algorithm is then leveraged for subtree integration, treating it as an optimal path search problem from the root node to the leaf node. This process optimizes the search subtree, thereby enhancing the robustness and security of the control architecture. To expedite search speed and algorithm convergence, this paper recommends reducing the search space by pre-grouping conditions and states within the behavior tree. The efficacy and superiority of the proposed algorithm are validated through security and timeliness evaluations of the BT, along with comparisons with other algorithms for automatic AUV decision control behavior tree design. Ultimately, the effectiveness and superiority of the proposed algorithm are corroborated through simulations on a multi-AUV complex task platform, showcasing its practical applicability and efficiency in real-world underwater scenarios.

Agent-based and Team-oriented Architecture for AUV

Development of an AUV “Xuanwu-1” with Docking Function

Three-Dimensional Coordination Control for Multiple Autonomous Underwater Vehicles

Design of Heterogeneous Multi-AUV IoUT: Architecture, Key Technologies and Applications

An Autonomous Reactive Architecture for Efficient AUV Mission Time Management in Realistic Severe Ocean Environment

Research on hierarchical control architecture for autonomous underwater vehicle

A Path Planning Approach for Multi-AUV Systems with Concurrent Stationary Node Access and Adaptive Sampling

Multi-AUV Collaborative Data Collection and Trajectory Planning in Integrated Sensing and Communication for Underwater Acoustic Networks

Underwater Multi-agent Cooperative Formation Hunting Based on Deep Reinforcement Learning

USV-AUV Collaboration Framework for Underwater Tasks under Extreme Sea Conditions

Enhancing Autonomous Underwater Vehicle Decision Making through Intelligent Task Planning and Behavior Tree Optimization

A Survey of Autonomous Underwater Vehicle Formation: Performance, Formation Control, and Communication Capability

Autonomous Reactive Mission Scheduling and Task-Path Planning Architecture for Autonomous Underwater Vehicle

A Novel Versatile Architecture for Autonomous Underwater Vehicle's Motion Planning and Task Assignment

Development of AUV Mechatronics Integration for Underwater Intervention Tasks

Environment-Aware AUV Trajectory Design and Resource Management for Multi-Tier Underwater Computing

Multi-AUV Cooperative Underwater Multi-Target Tracking Based on Dynamic-Switching-enabled Multi-Agent Reinforcement Learning

A survey of underwater search for multi-target using Multi-AUV: Task allocation, path planning, and formation control

A hybrid control architecture for an autonomous underwater vehicle (auv)

A Multi-AUV Path Planning System Based on the Omni-Directional Sensing Ability

Design and Implementation of Lightweight AUV with Multisensor Aided for Underwater Intervention Tasks