Abstract:The expansion of underwater scenarios and missions highlights the crucial need for autonomous underwater vehicles (AUVs) to make informed decisions. Therefore, developing an efficient decision-making framework is vital to enhance productivity in executing complex tasks within tight time constraints. This paper delves into task planning and reconstruction within the AUV control decision system to enable intelligent completion of intricate underwater tasks. Behavior trees (BTs) offer a structured approach to organizing the switching structure of a hybrid dynamical system (HDS), originally introduced in the computer game programming community. In this research, an intelligent search algorithm, MCTS-QPSO (Monte Carlo tree search and quantum particle swarm optimization), is proposed to bolster the AUV's capacity in planning complex task decision control systems. This algorithm tackles the issue of the time-consuming manual design of control systems by effectively integrating BTs. By assessing a predefined set of subtasks and actions in tandem with the complex task scenario, a reward function is formulated for MCTS to pinpoint the optimal subtree set. The QPSO algorithm is then leveraged for subtree integration, treating it as an optimal path search problem from the root node to the leaf node. This process optimizes the search subtree, thereby enhancing the robustness and security of the control architecture. To expedite search speed and algorithm convergence, this paper recommends reducing the search space by pre-grouping conditions and states within the behavior tree. The efficacy and superiority of the proposed algorithm are validated through security and timeliness evaluations of the BT, along with comparisons with other algorithms for automatic AUV decision control behavior tree design. Ultimately, the effectiveness and superiority of the proposed algorithm are corroborated through simulations on a multi-AUV complex task platform, showcasing its practical applicability and efficiency in real-world underwater scenarios.

UUV Autonomous Decision-Making Method Based on Dynamic Influence Diagram

Collaborative task decision-making of multi-UUV in dynamic environments based on deep reinforcement learning

An adaptive dynamic window approach for UUV obstacle avoidance planning in 3D environments

Research on Unmanned Underwater Vehicle Threat Assessment

Dynamic adaptive intelligent navigation decision making method for multi-object situation in open water

Enhancing Autonomous Underwater Vehicle Decision Making through Intelligent Task Planning and Behavior Tree Optimization

A Hybrid Path Planning Algorithm for Unmanned Surface Vehicles in Complex Environment with Dynamic Obstacles.

AUV Path Planning Based on Differential Evolution with Environment Prediction

Adaptive Re-planning of AUVs for Environmental Sampling Missions: A Fuzzy Decision Support System Based on Multi-objective Particle Swarm Optimization

Path planning and obstacle avoidance control of UUV based on an enhanced A* algorithm and MPC in dynamic environment

Numerical Simulation of Time-Optimal Path Planning for Autonomous Underwater Vehicles Using a Markov Decision Process Method

Achieving optimal-dynamic path planning for unmanned surface vehicles: A rational multi-objective approach and a sensory-vector re-planner

Man-in-the-Loop Control and Mission Planning for Unmanned Underwater Vehicles

AUV Motion Planning in Uncertain Flow Fields Using Bayes Adaptive MDPs

Trajectory Planning of UUV-assisted UWOC Systems Based on DQN

UUV's Hierarchical DE-based Motion Planning in a Semi Dynamic Underwater Wireless Sensor Network

Multi-AUV Dynamic Maneuver Countermeasure Algorithm Based on Interval Information Game and Fractional-Order DE

An Information-Assisted Deep Reinforcement Learning Path Planning Scheme for Dynamic and Unknown Underwater Environment

Robust Satisficing Decision Making for Unmanned Aerial Vehicle Complex Missions under Severe Uncertainty

An Efficient Hybrid Route-Path Planning Model For Dynamic Task Allocation and Safe Maneuvering of an Underwater Vehicle in a Realistic Environment

Uav Collision Avoidance Decision And 3d Path Re-Planning Method Based On Improved Interfered Fluid Dynamical System And Rolling Optimization