Abstract:Autonomous underwater vehicles (AUVs) have become important tools in the ocean exploration and have drawn considerable attention. Precise control for AUVs is the prerequisite to effectively execute underwater tasks. However, the classical control methods such as model predictive control (MPC) rely heavily on the dynamics model of the controlled system which is difficult to obtain for AUVs. To address this issue, a new reinforcement learning (RL) framework for AUV path-following control is proposed in this paper. Specifically, we propose a novel actor-model-critic (AMC) architecture integrating a neural network model with the traditional actor-critic architecture. The neural network model is designed to learn the state transition function to explore the spatio-temporal change patterns of the AUV as well as the surrounding environment. Based on the AMC architecture, a RL-based controller agent named ModelPPO is constructed to control the AUV. With the required sailing speed achieved by a traditional proportional-integral (PI) controller, ModelPPO can control the rudder and elevator fins so that the AUV follows the desired path. Finally, a simulation platform is built to evaluate the performance of the proposed method that is compared with MPC and other RL-based methods. The obtained results demonstrate that the proposed method can achieve better performance than other methods, which demonstrate the great potential of the advanced artificial intelligence methods in solving the traditional motion control problems for intelligent vehicles.

Type-2 Fuzzy Logic Neural Network Control and Target Following for Remote Operated Vehicles

Neural Network Control Approach of a Midwater Trawl System Based on Feedback Linearization

Neural Network Model-Based Reinforcement Learning Control for AUV 3-D Path Following

Collision Avoidance and Path Point Tracking Control for Underactuated Unmanned Surface Vehicles with Unknown Model Nonlinearity

Adaptive Neural Network Iterative Sliding Mode Course Tracking Control for Unmanned Surface Vessels

Application of Fuzzy Theory and Optimum Computing to the Obstacle Avoidance Control of Unmanned Underwater Vehicles

A neural network based controller for underwater robotic vehicles

Adaptive neural network fixed-time sliding mode control for trajectory tracking of underwater vehicle

Single degree of freedom control based on deep reinforcement learning for underwater unmanned vehicle

Fuzzy neural network adaptive AUV control based on FTHGO

Survey on Fuzzy-Logic-Based Guidance and Control of Marine Surface Vehicles and Underwater Vehicles

Type-2 Fuzzy Hybrid Controller Network for Robotic Systems

Dynamics Modeling and Motion Control of an New Unmanned Underwater Vehicle

Trajectory tracking control of a Remotely Operated Underwater Vehicle based on Fuzzy Disturbance Adaptation and Controller Parameter Optimization

Path following of an Underactuated AUV Based on Fuzzy Backstepping Sliding Mode Control

Command-Filtered Robust Adaptive NN Control With the Prescribed Performance for the 3-D Trajectory Tracking of Underactuated AUVs

An Adaptive Sliding Mode Control Strategy for the Heading Control of Autonomous Underwater Vehicles

Event-triggered output-feedback adaptive tracking control of autonomous underwater vehicles using reinforcement learning

EKF-Neural Network Observer Based Type-2 Fuzzy Control of Autonomous Vehicles

Adaptive hierarchical interval type-2 fuzzy control for trajectory tracking of an underactuated AUV with uncertain dynamics