Abstract:In this paper, an adversarial deep reinforcement learning-based control method is proposed to address the issue of robust depth tracking of an underactuated autonomous underwater vehicle in the presence of intrinsic coupled dynamics and external disturbances. First, long-short-term-memory neural network is presented to memorize and predict the changes in the state of vehicle, and a cascaded multilayer perception projects the output into action space of vehicle. Subsequently, adversarial deep reinforcement learning scheme is applied to the training of control agent by introducing an adversary which counteracts the control behavior, whereby the agent is enabled to learn the control strategy in different distributions of state transition. For evaluation of the performance, a control agent is pre-trained in simulation environment based on the reliable digital model of a real vehicle, and the simulation environment is paced at one iteration per second to align with real-time operations to ensure the portability of training result. Furthermore, the training cost is also extremely reduced. Finally, experiments are conducted with time-varying disturbances to further prove the feasibility of the proposed learning-based control scheme on a prototype of underwater vehicle in towing tank. Moreover, comparative experiment results show the better robustness performance of the learning-based control agent than that of classic line-of-sight based proportional–integral–derivative and adaptive line-of-sight based proportional–integral–derivative controllers in different scenarios.

Motion Control of Underwater Vehicles Based on Robust Neural Network

MOTION CONTROL OF UNDERWATER VEHICLE BASED ON LEAST DISTURBANCE BP ALGORITHM

Robust Neural-Network Hybrid Tracking Control Of Underwater Vehicles

Neural Network Based Robust Adaptive Tracking Control for the Automomous Underwater Vehicle

Variable Structure Neural Network Control of an Open-frame Underwater Vehicle

Fuzzy Neural Network Control of Underwater Vehicles Based on Desired State Programming

Motion Control of Mini Underwater Robots Based on Sigmoid Fuzzy Neural Network

Underwater autonomous motion control of a small-scaled spherical robot with neural networks

Adaptive Learning Based Tracking Control of Marine Vessels with Prescribed Performance

Neural Network Based Robust Controller for Trajectory Tracking of Underwater Vehicles

Parallel Neural Network-Based Motion Controller for Autonomous Underwater Vehicles

Adversarial Deep Reinforcement Learning Based Robust Depth Tracking Control for Underactuated Autonomous Underwater Vehicle

Neural Network Identification and Learning Control of Uncertain AUV

Generalized Sigmoid Fuzzy Neural Network Control for Mini Underwater Vehicles

A neural network based controller for underwater robotic vehicles

Real-Time Control of Autonomous Underwater Vehicles Based on Fuzzy Neural Network

Sigmoid Fuzzy Neural Network-Based Motion Control For Mini Underwater Robots

Adaptive Recurrent Neural Network Motion Control for Observation Class Remotely Operated Vehicle Manipulator System with Modeling Uncertainty

Biomimetic Underwater Vehicle Modeling Based on Neural Network

Neural Network Modeling and Generalized Predictive Control for an Autonomous Underwater Vehicle

Neural Network Based Robust Adaptive Dynamic Surface Control for AUVs