Abstract:Autonomous underwater vehicles (AUVs) have become important tools in the ocean exploration and have drawn considerable attention. Precise control for AUVs is the prerequisite to effectively execute underwater tasks. However, the classical control methods such as model predictive control (MPC) rely heavily on the dynamics model of the controlled system which is difficult to obtain for AUVs. To address this issue, a new reinforcement learning (RL) framework for AUV path-following control is proposed in this paper. Specifically, we propose a novel actor-model-critic (AMC) architecture integrating a neural network model with the traditional actor-critic architecture. The neural network model is designed to learn the state transition function to explore the spatio-temporal change patterns of the AUV as well as the surrounding environment. Based on the AMC architecture, a RL-based controller agent named ModelPPO is constructed to control the AUV. With the required sailing speed achieved by a traditional proportional-integral (PI) controller, ModelPPO can control the rudder and elevator fins so that the AUV follows the desired path. Finally, a simulation platform is built to evaluate the performance of the proposed method that is compared with MPC and other RL-based methods. The obtained results demonstrate that the proposed method can achieve better performance than other methods, which demonstrate the great potential of the advanced artificial intelligence methods in solving the traditional motion control problems for intelligent vehicles.

Fuzzy neural network controller for AUV based on RAN

A FNN control of underwater vehicles based on ant colony algorithm

Real-Time Control of Autonomous Underwater Vehicles Based on Fuzzy Neural Network

A Fuzzy Neural Networks Controller of Underwater Vehicles Based on Ant Colony Algorithm

HPSO-based Fuzzy Neural Network Control for AUV

Fuzzy neural network adaptive AUV control based on FTHGO

Neural Network Model-Based Reinforcement Learning Control for AUV 3-D Path Following

Design of AUV height control based on adaptive neuro-fuzzy inference system

A fuzzy logic controller designed based on CPN and its application

Adaptive Output Feedback Control Based on DRFNN for AUV

Heading Control of Unmanned Marine Vehicles Based on an Improved Robust Adaptive Fuzzy Neural Network Control Algorithm

A fault-tolerable recurrent neural network controller for remote operated vehicle

Variable Universe Based Fuzzy Control System Design for Auv

Type-2 Fuzzy Logic Neural Network Control and Target Following for Remote Operated Vehicles

Fuzzy neural network control of AUV based on IPSO

T-S norm FNN controller based on hybrid learning algorithm

Adaptive output feedback control of AUV

Modified Learning of T-S Fuzzy Neural Network Control for Autonomous Underwater Vehicles

T-S norm fuzzy neural network controller for underwater vehicles based on hybrid learning algorithm

Tracking Control of Underactuated Unmanned Surface Vessels Based on the Dynamic Fuzzy Neural Network

DRFNN-adaptive Output Feedback Controller for Depth Tracking of AUV