Abstract:Autonomous underwater vehicles (AUVs) have become important tools in the ocean exploration and have drawn considerable attention. Precise control for AUVs is the prerequisite to effectively execute underwater tasks. However, the classical control methods such as model predictive control (MPC) rely heavily on the dynamics model of the controlled system which is difficult to obtain for AUVs. To address this issue, a new reinforcement learning (RL) framework for AUV path-following control is proposed in this paper. Specifically, we propose a novel actor-model-critic (AMC) architecture integrating a neural network model with the traditional actor-critic architecture. The neural network model is designed to learn the state transition function to explore the spatio-temporal change patterns of the AUV as well as the surrounding environment. Based on the AMC architecture, a RL-based controller agent named ModelPPO is constructed to control the AUV. With the required sailing speed achieved by a traditional proportional-integral (PI) controller, ModelPPO can control the rudder and elevator fins so that the AUV follows the desired path. Finally, a simulation platform is built to evaluate the performance of the proposed method that is compared with MPC and other RL-based methods. The obtained results demonstrate that the proposed method can achieve better performance than other methods, which demonstrate the great potential of the advanced artificial intelligence methods in solving the traditional motion control problems for intelligent vehicles.

A Model Predictive Path Following Control Method for Underactuated Autonomous Underwater Vehicles

A Model Predictive Control Approach for USV Autonomous Cruising Via Disturbance Learning

Path Following of Autonomous Surface Vehicles with Line-of-sight and Nonlinear Model Predictive Control

Parameter Identification and Model Prediction Path Following Control of Underactuated AUV: Methodology and Experimental Verification

Model Predictive Control for an Auv with Dynamic Path Planning

Unmanned Surface Vehicle Path Following Based on Model Predictive Control

Deep Reinforcement Learning with Model Predictive Control for Path Following of Autonomous Underwater Vehicle

Autonomous Underwater Vehicle (AUV) Motion Design: Integrated Path Planning and Trajectory Tracking Based on Model Predictive Control (MPC)

Path Following Based on Waypoints and Real-Time Obstacle Avoidance Control of an Autonomous Underwater Vehicle

Path Following Model Predictive Control of a Coupled Autonomous Underwater Vehicle

Neural Network Model-Based Reinforcement Learning Control for AUV 3-D Path Following

Model Predictive Path Following Control of Underwater Vehicle Based on RBF Neural Network

Path-Following Control of an Auv Using Multi-Objective Model Predictive Control

Comparison of Linear and Nonlinear Model Predictive Control in Path Following of Underactuated Unmanned Surface Vehicles

Computationally Efficient MPC for Path Following of Underactuated Marine Vessels Using Projection Neural Network

Path-Following Control of an AUV: A Multiobjective Model Predictive Control Approach

Predictive Path Following for Unmanned Surface Vessel Based on Adaptive Line-of-Sight

Model Predictive Control of Autonomous Underwater Vehicles for Trajectory Tracking with External Disturbances

Modeling and Trajectory Tracking Model Predictive Control Novel Method of AUV Based on CFD Data.

Underactuated AUV Path Following Control Based on Adaptive Backstepping Method.

Trajectory Tracking Control of an Autonomous Underwater Vehicle Using Lyapunov-Based Model Predictive Control