Abstract:In the field of ocean energy detection, Autonomous Underwater Vehicles (AUVs) offer significant advantages in terms of manpower, resource, and energy efficiency. However, the unpredictable nature of the ocean environment, particularly the real-time changes in ocean currents, poses navigational risks for AUVs. Therefore, effective path planning in dynamic environments is crucial for AUVs to perform specific tasks. This paper addresses the static path planning problem and proposes a model called the noise net double DQN network with prioritized experience replay (N-DDQNP). The N-DDQNP model combines a noise network and a prioritized experience replay mechanism to address the limited exploration and slow convergence speed issues of the DQN algorithm, which are caused by the greedy strategy and uniform sampling mechanism. The proposed approach involves constructing a double DQN network with a priority experience replay and an exploration mechanism using the noise network. Second, a compound reward function is formulated to take into account ocean current, distance, and safety factors, ensuring prompt feedback during the training process. Regarding the ocean current, the reward function is designed based on the angle between the current direction and the AUV's heading direction, considering its impact on the AUV's speed. As for the distance factor, the reward is determined by the Euclidean distance between the current position and the target point. Furthermore, the safety factor considers whether the AUV may collide with obstacles. By incorporating these three factors, the compound reward function is established. To evaluate the performance of the N-DDQNP model, experiments were conducted using real ocean data in various complex ocean environments. The results demonstrate that the path planning time of the N-DDQNP model outperforms other algorithms in different ocean current scenarios and obstacle environments. Furthermore, a user console-AUV connection has been established using spice cloud desktop technology. The cloud desktop architecture enables intuitive observation of the AUV's navigation posture and the surrounding marine environment, facilitating safer and more efficient underwater exploration and marine resource detection tasks.

AUV-Assisted Subsea Exploration Method in 6G Enabled Deep Ocean Based on a Cooperative Pac-Men Mechanism

Cooperative Coverage Path Planning for AUVs in Integrated Underwater Acoustic Communication and Detection Networks

A Heterogeneous Network with Multiple Routing Protocols for Autonomous Underwater Vehicles

A Path Planning Approach for Multi-AUV Systems with Concurrent Stationary Node Access and Adaptive Sampling

Heuristic Surface Path Planning Method for AMV-Assisted Internet of Underwater Things

Multi-AUV Collaborative Data Collection and Trajectory Planning in Integrated Sensing and Communication for Underwater Acoustic Networks

Early Warning Obstacle Avoidance-Enabled Path Planning for Multi-AUV-Based Maritime Transportation Systems

Intelligent Multi-AUG Ocean Data Collection Scheme in Maritime Wireless Communication Network

A Multi-Robot Coverage Path Planning Method for Maritime Search and Rescue Using Multiple AUVs

AUV Path Planning Considering Ocean Current Disturbance Based on Cloud Desktop Technology

Multi-Agent Deep Reinforcement Learning Framework Strategized by Unmanned Aerial Vehicles for Multi-Vessel Full Communication Connection

A Cooperative-Control-Based Underwater Target Escorting Mechanism With Multiple Autonomous Underwater Vehicles for Underwater Internet of Things

LSDA-APF: A Local Obstacle Avoidance Algorithm for Unmanned Surface Vehicles Based on 5G Communication Environment

USV-AUV Collaboration Framework for Underwater Tasks under Extreme Sea Conditions

Dynamic Packet Routing Based on Acoustic Signal Curve Propagation in the AUV-Assisted IoUT

Joint Autonomous Underwater Vehicle Trajectory and Energy Optimization for Underwater Covert Communications

Multi-AUV coverage path planning algorithm using side-scan sonar for maritime search

Heterogeneous Multi-AUV Aided Green Internet of Underwater Things

Unlocking the Ocean 6G: A Review of Path-Planning Techniques for Maritime Data Harvesting Assisted by Autonomous Marine Vehicles

A Multi-AUV Path Planning System Based on the Omni-Directional Sensing Ability

Reinforcement Learning Based Obstacle Avoidance for AUV Swarm in Dynamic Ocean Environment