Abstract:As one of the commonly used vehicles for underwater detection, underwater robots are facing a series of problems. The real underwater environment is large-scale, complex, real-time and dynamic, and many unknown obstacles may exist in the underwater environment. Under such complex conditions and lack of prior knowledge, the existing path planning methods are difficult to plan, therefore they cannot effectively meet the actual demands. In response to these problems, a three-dimensional marine environment including multiple obstacles is established with the real ocean current data in this paper, which is consistent with the actual application scenarios. Then, we propose an N-step Priority Double DQN (NPDDQN) path planning algorithm, which potently realizes obstacle avoidance in the complex environment. In addition, this study proposes an experience screening mechanism, which screens the explored positive experience and improves its reuse rate, thus efficiently improving the algorithm stability in the dynamic environment. This paper verifies the better performance of reinforcement learning compared with a variety of traditional methods in three-dimensional underwater path planning. Underwater robots based on the proposed method have good autonomy and stability, which provides a new method for path planning of underwater robots. Note to Practitioners—The goal of this study is to provide a new solution for obstacle avoidance in path planning of underwater robots, which is consistent with the dynamic and real-time demands of the real environment. Existing underwater path planning researches lack a consistent environment with the actual application, and therefore we firstly construct a three-dimensional ocean environment with real ocean current data to provide support for the algorithms. Additionally, most of the algorithms are pre-planning methods or require long-time calculation, and there is little research on obstacle avoidance. In the face of obstacle changes, underwater robots with poor adaptability will cause performance decline and even economic losses. The proposed algorithm learns through interaction with the environment, and therefore it does not require any prior experience, and has good adaptability as well as fast inference speed. Especially, in the dynamic environment, algorithm performance is difficult to guarantee due to less positive experience in exploration. The proposed experience screening mechanism improves the stability of the algorithm, so that the underwater robot maintains stable performance in different dynamic environments.

An Effective Obstacle Avoidance and Motion Planning Design for Underwater Telescopic Arm Robots Based on a Tent Chaotic Dung Beetle Algorithm

Enhancing Swarm Intelligence for Obstacle Avoidance with Multi-Strategy and Improved Dung Beetle Optimization Algorithm in Mobile Robot Navigation

A Hybrid Path Planning Algorithm for Unmanned Surface Vehicles in Complex Environment with Dynamic Obstacles.

Multi-Strategy Enhanced Dung Beetle Optimizer and Its Application in Three-Dimensional UAV Path Planning

Robot Manipulator Minimum Jerk Trajectory Planning Based on the Improved Dung Beetle Optimizer Algorithm

Improved Dung Beetle Optimizer Algorithm With Multi-Strategy for Global Optimization and UAV 3D Path Planning

An Adaptive Spiral Strategy Dung Beetle Optimization Algorithm: Research and Applications

Dynamic Analysis and Path Planning of a Turtle-Inspired Amphibious Spherical Robot

A path planning algorithm for mobile robot based on water flow potential field method and beetle antennae search algorithm

Robot path planning based on improved dung beetle optimizer algorithm

Research on Move-to-Escape Enhanced Dung Beetle Optimization and Its Applications

Underwater Submarine Path Planning Based on Artificial Potential Field Ant Colony Algorithm and Velocity Obstacle Method

UAV path planning based on improved dung beetle algorithm with multiple strategy integration

Path Planning of Robot Based on Improved Multi-Strategy Fusion Whale Algorithm

3D Path Planning and Obstacle Avoidance Algorithms for Obstacle-Overcoming Robots

Intelligent Path Planning of Underwater Robot Based on Reinforcement Learning

Path Planning for Autonomous Underwater Vehicles: An Ant Colony Algorithm Incorporating Alarm Pheromone

Obstacle Avoidance and Near Time-Optimal Trajectory Planning of a Robotic Manipulator Based on an Improved Whale Optimisation Algorithm

A Multiobjective Hybrid Optimization Algorithm for Path Planning of Coal Mine Patrol Robot

Joints Trajectory Planning of Robot Based on Slime Mould Whale Optimization Algorithm

An Efficient End-to-End Obstacle Avoidance Path Planning Algorithm for Intelligent Vehicles Based on Improved Whale Optimization Algorithm