Enhancing Autonomous Underwater Vehicle Decision Making through Intelligent Task Planning and Behavior Tree Optimization

Dan Yu,Hongjian Wang,Xu Cao,Zhao Wang,Jingfei Ren,Kai Zhang

DOI: https://doi.org/10.3390/jmse12050791

IF: 2.744

2024-05-09

Journal of Marine Science and Engineering

Abstract:The expansion of underwater scenarios and missions highlights the crucial need for autonomous underwater vehicles (AUVs) to make informed decisions. Therefore, developing an efficient decision-making framework is vital to enhance productivity in executing complex tasks within tight time constraints. This paper delves into task planning and reconstruction within the AUV control decision system to enable intelligent completion of intricate underwater tasks. Behavior trees (BTs) offer a structured approach to organizing the switching structure of a hybrid dynamical system (HDS), originally introduced in the computer game programming community. In this research, an intelligent search algorithm, MCTS-QPSO (Monte Carlo tree search and quantum particle swarm optimization), is proposed to bolster the AUV's capacity in planning complex task decision control systems. This algorithm tackles the issue of the time-consuming manual design of control systems by effectively integrating BTs. By assessing a predefined set of subtasks and actions in tandem with the complex task scenario, a reward function is formulated for MCTS to pinpoint the optimal subtree set. The QPSO algorithm is then leveraged for subtree integration, treating it as an optimal path search problem from the root node to the leaf node. This process optimizes the search subtree, thereby enhancing the robustness and security of the control architecture. To expedite search speed and algorithm convergence, this paper recommends reducing the search space by pre-grouping conditions and states within the behavior tree. The efficacy and superiority of the proposed algorithm are validated through security and timeliness evaluations of the BT, along with comparisons with other algorithms for automatic AUV decision control behavior tree design. Ultimately, the effectiveness and superiority of the proposed algorithm are corroborated through simulations on a multi-AUV complex task platform, showcasing its practical applicability and efficiency in real-world underwater scenarios.

oceanography,engineering, marine, ocean

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the decision - making challenges faced by autonomous underwater vehicles (AUVs) when performing complex tasks. With the expansion of underwater application scenarios and tasks, AUVs need to make more intelligent and efficient decisions. The traditional manually - designed control systems are inefficient and difficult to adapt to complex task requirements. Especially in multi - AUV systems, the increase in task complexity and the number of AUVs makes manual design even more difficult. Therefore, it is crucial to develop an effective decision - making framework to improve the productivity and decision - making efficiency of AUVs when performing complex tasks, especially in time - critical situations. Specifically, the paper focuses on the following aspects: 1. **Time - consuming problem of manual design**: Manually - designed decision - making control systems cannot meet the time requirements when complex tasks or the number of AUVs increase. 2. **Balancing safety and efficiency**: Ensuring the safety of AUV operations while efficiently completing tasks, especially in complex scenarios, is a key challenge. 3. **Enhancing the decision - making structure**: Utilize the reactive decision - making control structure to achieve the transition from goal - driven behavior to a more effective decision - making process. To solve these problems, the paper proposes an automatic decision - making system generation algorithm based on the combination of behavior trees (BTs), Monte Carlo tree search (MCTS) and quantum particle swarm optimization (QPSO) algorithm. Through this method, optimized behavior trees can be automatically generated, thereby improving the decision - making efficiency and safety of AUVs in complex tasks. The paper verifies the effectiveness of the proposed algorithm through a series of experiments and demonstrates its feasibility and superiority in practical applications.

Enhancing Autonomous Underwater Vehicle Decision Making through Intelligent Task Planning and Behavior Tree Optimization

Improving the Modularity of AUV Control Systems using Behaviour Trees

Multi-AUV dynamic trajectory optimization and collaborative search combined with task urgency and energy consumption scheduling in 3-D underwater environment with random ocean currents and uncertain obstacles

A Hierarchical Planning Method for AUV Search Tasks Based on the Snake Optimization Algorithm

An Autonomous Reactive Architecture for Efficient AUV Mission Time Management in Realistic Severe Ocean Environment

A Path Planning Approach for Multi-AUV Systems with Concurrent Stationary Node Access and Adaptive Sampling

Autonomous Reactive Mission Scheduling and Task-Path Planning Architecture for Autonomous Underwater Vehicle

A multi-objective bi-level task planning strategy for UUV target visitation in ocean environment

A Hybrid Path Planning Algorithm for Unmanned Surface Vehicles in Complex Environment with Dynamic Obstacles.

A novel reinforcement learning based tuna swarm optimization algorithm for autonomous underwater vehicle path planning

An Efficient Hybrid Route-Path Planning Model For Dynamic Task Allocation and Safe Maneuvering of an Underwater Vehicle in a Realistic Environment

A Novel Versatile Architecture for Autonomous Underwater Vehicle's Motion Planning and Task Assignment

Multi-Objective Path Planning of Autonomous Underwater Vehicles Driven by Manta Ray Foraging

Environment-Aware AUV Trajectory Design and Resource Management for Multi-Tier Underwater Computing

Hierarchical dynamic trajectory planning for autonomous underwater vehicles: Algorithms and experiments

Adaptive Re-planning of AUVs for Environmental Sampling Missions: A Fuzzy Decision Support System Based on Multi-objective Particle Swarm Optimization

Correction Redistribution Mechanism Based on Forward-Reverse Solutions and Real-Time Path Dynamic Adaptive Re-Planning for Multi-AUVs Collaborative Search

Autonomous Underwater Vehicle-Manipulator Systems Path Planning with RRTAUVMS Algorithm

Path Planning for Autonomous Underwater Vehicles: An Ant Colony Algorithm Incorporating Alarm Pheromone

Online 3-Dimensional Path Planning with Kinematic Constraints in Unknown Environments Using Hybrid A* with Tree Pruning

ACO+PSO+A*: A bi-layer hybrid algorithm for multi-task path planning of an AUV