Abstract:An autonomous underwater vehicle (AUV) has shown impressive potential and promising exploitation prospects in numerous marine missions. Among its various applications, the most essential prerequisite is path planning. Although considerable endeavors have been made, there are several limitations. A complete and realistic ocean simulation environment is critically needed. As most of the existing methods are based on mathematical models, they suffer from a large gap with reality. At the same time, the dynamic and unknown environment places high demands on robustness and generalization. In order to overcome these limitations, we propose an information-assisted reinforcement learning path planning scheme. First, it performs numerical modeling based on real ocean current observations to establish a complete simulation environment with the grid method, including 3-D terrain, dynamic currents, local information, and so on. Next, we propose an information compression (IC) scheme to trim the mutual information (MI) between reinforcement learning neural network layers to improve generalization. A proof based on information theory provides solid support for this. Moreover, for the dynamic characteristics of the marine environment, we elaborately design a confidence evaluator (CE), which evaluates the correlation between two adjacent frames of ocean currents to provide confidence for the action. The performance of our method has been evaluated and proven by numerical results, which demonstrate a fair sensitivity to ocean currents and high robustness and generalization to cope with the dynamic and unknown underwater environment.

Mapless Motion Planning System for an Autonomous Underwater Vehicle Using Policy Gradient-based Deep Reinforcement Learning

End-to-End AUV Motion Planning Method Based on Soft Actor-Critic

Path Planning of Autonomous Underwater Vehicles for Optimal Environmental Sampling

Binocular Vision-Based Motion Planning of An AUV: A Deep Reinforcement Learning Approach

Deep reinforcement learning for adaptive path planning and control of an autonomous underwater vehicle

AUV Path Planning with Kinematic Constraints in Unknown Environment Using Reinforcement Learning.

An Information-Assisted Deep Reinforcement Learning Path Planning Scheme for Dynamic and Unknown Underwater Environment

Comprehensive Ocean Information-Enabled AUV Motion Planning Based on Reinforcement Learning

Research and Design of an Autonomous Underwater Vehicle Path Planning Method Based on Deep Reinforcement Learning

Communication-Aware Motion Planning of AUV in Obstacle-Dense Environment: A Binocular Vision-Based Deep Learning Method.

Path Planning of Unmanned Underwater Vehicles Based on Deep Reinforcement Learning Algorithm

Adaptive Energy-Efficient Reinforcement Learning for AUV 3D Motion Planning in Complex Underwater Environments

Path planning of autonomous underwater vehicle in unknown environment based on improved deep reinforcement learning

Path Planning based on Deep Reinforcement Learning for Autonomous Underwater Vehicles under Ocean Current Disturbance

Asynchronous Multithreading Reinforcement-Learning-Based Path Planning and Tracking for Unmanned Underwater Vehicle

A Motion Camouflage-Inspired Path Planning Method for UAVs Based on Reinforcement Learning

Neural Network Model-Based Reinforcement Learning Control for AUV 3-D Path Following

End-To-End Sensorimotor Control Problems Of Auvs With Deep Reinforcement Learning

Underwater Multi-agent Cooperative Formation Hunting Based on Deep Reinforcement Learning

Sim-to-Real: Mapless Navigation for USVs Using Deep Reinforcement Learning

Real-time Planning and Collision Avoidance Control Method Based on Deep Reinforcement Learning