Abstract:Vision-based motion planning of autonomous underwater vehicles (AUVs) is regarded as a critical requirement for marine intelligent transportation systems. However, the limited vision range and the uncertain model parameters of an AUV make it difficult to fulfill this requirement. This study focuses on a binocular-vision-based motion planning issue for an AUV. First, we develop an intelligent AUV system that mainly comprises binocular cameras for patrolling the target, a localization unit for acquiring the position information, and an acoustic modem for communicating with buoys. Accordingly, the parallax angles from the AUV to target are used to construct an optimal motion planning problem. To solve the aforementioned problem, we develop a deep reinforcement learning method called the improved twin delayed deep deterministic (TD3) policy gradient algorithm in order to minimize the reward function, such that the AUV can perpendicularly patrol the target with a fixed distance. The advantages of our solution are as follows: 1) the binocular-vision-based motion planning method can achieve a trade-off between motion stability and observation effectiveness; 2) the improved TD3 algorithm can accelerate the convergence compared to other algorithms, while it can simultaneously overcome the dependency on the model parameters of the AUV. Finally, simulation and experimental studies are conducted to verify the effectiveness.

Horizontal Motion Planning Based On Behavior Basic For Auv

3-D Behavior Coordination Mechanism for AUV Motion Planning

Hierarchical Motion Planning of AUVs in Three Typical Marine Environments

A Motion Planning Method for an Autonomous Underwater Vehicle with Kinematic Constraints

Implementation Of Hierarchical Fuzzy Behavior Planning For Auv In Large-Scale Ocean Environment

Research on autonomous planning for AUV in unstructured environment

Research on motion planning based on self-learning behavior agent for AUV

Binocular Vision-Based Motion Planning of An AUV: A Deep Reinforcement Learning Approach

Research on Obstacle Avoidance Planning for AUV Based on Forward Looking Sonar

Implementation of AUV local planning in strong sea flow field based on Q-learning

A Novel Control Architecture for Mission Re-Planning of AUV

AUV Path Planning with Kinematic Constraints in Unknown Environment Using Reinforcement Learning.

Behavior-based Collision Free Path Following Control of an Autonomous Underwater Vehicle

A General Motion Controller Based on Deep Reinforcement Learning for an Autonomous Underwater Vehicle with Unknown Disturbances.

Safe Motion Planning for Goal Reaching of Multiple Autonomous Surface Vehicles Based on High-order Control Barrier Functions

Hierarchical dynamic trajectory planning for autonomous underwater vehicles: Algorithms and experiments

3D path planning for AUV using fuzzy logic

OBSTACLE AVOIDANCE OF AUTONOMOUS UNDERWATER VEHICLES BASED ON BALANCE POINT OF MOTION

OceanPlan: Hierarchical Planning and Replanning for Natural Language AUV Piloting in Large-scale Unexplored Ocean Environments

AUV Motion Planning in Uncertain Flow Fields Using Bayes Adaptive MDPs

Motion Planning of Automatic Underwater Vehicle Based on 3D Dipolar Vector Field