Abstract:In the field of ocean energy detection, Autonomous Underwater Vehicles (AUVs) offer significant advantages in terms of manpower, resource, and energy efficiency. However, the unpredictable nature of the ocean environment, particularly the real-time changes in ocean currents, poses navigational risks for AUVs. Therefore, effective path planning in dynamic environments is crucial for AUVs to perform specific tasks. This paper addresses the static path planning problem and proposes a model called the noise net double DQN network with prioritized experience replay (N-DDQNP). The N-DDQNP model combines a noise network and a prioritized experience replay mechanism to address the limited exploration and slow convergence speed issues of the DQN algorithm, which are caused by the greedy strategy and uniform sampling mechanism. The proposed approach involves constructing a double DQN network with a priority experience replay and an exploration mechanism using the noise network. Second, a compound reward function is formulated to take into account ocean current, distance, and safety factors, ensuring prompt feedback during the training process. Regarding the ocean current, the reward function is designed based on the angle between the current direction and the AUV's heading direction, considering its impact on the AUV's speed. As for the distance factor, the reward is determined by the Euclidean distance between the current position and the target point. Furthermore, the safety factor considers whether the AUV may collide with obstacles. By incorporating these three factors, the compound reward function is established. To evaluate the performance of the N-DDQNP model, experiments were conducted using real ocean data in various complex ocean environments. The results demonstrate that the path planning time of the N-DDQNP model outperforms other algorithms in different ocean current scenarios and obstacle environments. Furthermore, a user console-AUV connection has been established using spice cloud desktop technology. The cloud desktop architecture enables intuitive observation of the AUV's navigation posture and the surrounding marine environment, facilitating safer and more efficient underwater exploration and marine resource detection tasks.

AUV Motion Planning in Uncertain Flow Fields Using Bayes Adaptive MDPs

Path Planning of Autonomous Underwater Vehicles for Optimal Environmental Sampling

Learning and Sampling-Based Informative Path Planning for AUVs in Ocean Current Fields

A Path Planning Approach for Multi-AUV Systems with Concurrent Stationary Node Access and Adaptive Sampling

Informative Path Planning for AUV-based Underwater Terrain Exploration with a POMDP

A Unified Closed-Loop Motion Planning Approach for an I-AUV in Cluttered Environment with Localization Uncertainty

Numerical Simulation of Time-Optimal Path Planning for Autonomous Underwater Vehicles Using a Markov Decision Process Method

Online Mapping and Motion Planning Under Uncertainty for Safe Navigation in Unknown Environments

Real-Time Planning Under Uncertainty for AUVs Using Virtual Maps

Communication-Aware Motion Planning of AUV in Obstacle-Dense Environment: A Binocular Vision-Based Deep Learning Method.

A Fully-Autonomous Framework of Unmanned Surface Vehicles in Maritime Environments Using Gaussian Process Motion Planning

An adaptive dynamic window approach for UUV obstacle avoidance planning in 3D environments

Dynamic Obstacle Avoidance of Unmanned Surface Vehicles in Maritime Environments Using Gaussian Processes Based Motion Planning

Risk-based path planning for autonomous underwater vehicles in an oil spill environment

An Information-Assisted Deep Reinforcement Learning Path Planning Scheme for Dynamic and Unknown Underwater Environment

Hierarchical dynamic trajectory planning for autonomous underwater vehicles: Algorithms and experiments

Path planning and obstacle avoidance control of UUV based on an enhanced A* algorithm and MPC in dynamic environment

AUV Path Planning Considering Ocean Current Disturbance Based on Cloud Desktop Technology

Binocular Vision-Based Motion Planning of An AUV: A Deep Reinforcement Learning Approach

An Obstacle Avoidance Strategy for AUV Based on State-Tracking Collision Detection and Improved Artificial Potential Field

Adaptive Formation Learning Control for Cooperative AUVs under Complete Uncertainty