Abstract:An autonomous underwater vehicle (AUV) has shown impressive potential and promising exploitation prospects in numerous marine missions. Among its various applications, the most essential prerequisite is path planning. Although considerable endeavors have been made, there are several limitations. A complete and realistic ocean simulation environment is critically needed. As most of the existing methods are based on mathematical models, they suffer from a large gap with reality. At the same time, the dynamic and unknown environment places high demands on robustness and generalization. In order to overcome these limitations, we propose an information-assisted reinforcement learning path planning scheme. First, it performs numerical modeling based on real ocean current observations to establish a complete simulation environment with the grid method, including 3-D terrain, dynamic currents, local information, and so on. Next, we propose an information compression (IC) scheme to trim the mutual information (MI) between reinforcement learning neural network layers to improve generalization. A proof based on information theory provides solid support for this. Moreover, for the dynamic characteristics of the marine environment, we elaborately design a confidence evaluator (CE), which evaluates the correlation between two adjacent frames of ocean currents to provide confidence for the action. The performance of our method has been evaluated and proven by numerical results, which demonstrate a fair sensitivity to ocean currents and high robustness and generalization to cope with the dynamic and unknown underwater environment.

A Novel Path Planning Approach For Unmanned Ships Based On Deep Reinforcement Learning

A knowledge-free path planning approach for smart ships based on reinforcement learning

An Autonomous Path Planning Model for Unmanned Ships Based on Deep Reinforcement Learning

Path Planning of Maritime Autonomous Surface Ships in Unknown Environment with Reinforcement Learning

Deep Reinforcement Learning-Based Path Control and Optimization for Unmanned Ships

Deep Reinforcement Learning Based Path Planning and Collision Avoidance for Smart Ships in Complex Environments

Navigation Situation Adaptive Learning-Based Path Planning of Maritime Autonomous Surface Ships

Research on Path Planning based on Unmanned Ship

Path Planning Algorithm for Unmanned Surface Vessel Based on Multiobjective Reinforcement Learning

Neural Network Model-Based Reinforcement Learning Control for AUV 3-D Path Following

AUV Path Planning with Kinematic Constraints in Unknown Environment Using Reinforcement Learning.

Adaptive Path Planning for Autonomous Ships Based on Deep Reinforcement Learning Combined with Images

A Hybrid Path Planning Method for an Unmanned Cruise Ship in Water Quality Sampling

A novel path planning approach for smart cargo ships based on anisotropic fast marching

A Ship Path Planning System Utilizing Virtual Reality and Numerical Simulation

Physical Consistent Path Planning for Unmanned Surface Vehicles under Complex Marine Environment

Dynamic trajectory planning for unmanned ship under multi-object environment

A path planning strategy unified with a COLREGS collision avoidance function based on deep reinforcement learning and artificial potential field

An Information-Assisted Deep Reinforcement Learning Path Planning Scheme for Dynamic and Unknown Underwater Environment

Soft Actor-Critic and Risk Assessment-Based Reinforcement Learning Method for Ship Path Planning

Improved reinforcement learning for collision-free local path planning of dynamic obstacle