Abstract:In this paper, an adversarial deep reinforcement learning-based control method is proposed to address the issue of robust depth tracking of an underactuated autonomous underwater vehicle in the presence of intrinsic coupled dynamics and external disturbances. First, long-short-term-memory neural network is presented to memorize and predict the changes in the state of vehicle, and a cascaded multilayer perception projects the output into action space of vehicle. Subsequently, adversarial deep reinforcement learning scheme is applied to the training of control agent by introducing an adversary which counteracts the control behavior, whereby the agent is enabled to learn the control strategy in different distributions of state transition. For evaluation of the performance, a control agent is pre-trained in simulation environment based on the reliable digital model of a real vehicle, and the simulation environment is paced at one iteration per second to align with real-time operations to ensure the portability of training result. Furthermore, the training cost is also extremely reduced. Finally, experiments are conducted with time-varying disturbances to further prove the feasibility of the proposed learning-based control scheme on a prototype of underwater vehicle in towing tank. Moreover, comparative experiment results show the better robustness performance of the learning-based control agent than that of classic line-of-sight based proportional–integral–derivative and adaptive line-of-sight based proportional–integral–derivative controllers in different scenarios.

Neural Network Based Robust Adaptive Tracking Control for the Automomous Underwater Vehicle

An Underactuated AUV Tracking Algorithm Based on Backstepping Adaptive Sliding Mode Control

A DSC and MLP based robust adaptive NN tracking control for underwater vehicle

A Novel Approach to Robust Adaptive NN Tracking Control for AUVs

Trajectory Tracking Controller Design for Underactuated AUVs Based on Adaptive Robust Control

Neural Network Based Robust Adaptive Dynamic Surface Control for AUVs

Adaptive Learning Based Tracking Control of Marine Vessels with Prescribed Performance

Adaptive Robust Trajectory-Tracking Control for Underactuated USVs with Model Uncertainty and Environmental Disturbance

Robust Neural-Network Hybrid Tracking Control Of Underwater Vehicles

Neural Network Based Robust Controller for Trajectory Tracking of Underwater Vehicles

Fully-tuned Fuzzy Neural Network Based Robust Adaptive Tracking Control of Unmanned Underwater Vehicle with Thruster Dynamics.

Three-dimensional Path Tracking Control for Autonomous Underwater Vehicle Based on Neural Network

Neural Network H-infinity Robust Adaptive Control for Autonomous Underwater Vehicle in 3-Dimensional Path Following

Adaptive Neural Network Dynamic Surface Trajectory Tracking Control for Underactuated Autonomous Underwater Vehicles

Adversarial Deep Reinforcement Learning Based Robust Depth Tracking Control for Underactuated Autonomous Underwater Vehicle

Robust Adaptive Optimal Trajectory Tracking Control for Underactuated AUVs with Position and Velocity Constraints in Three‐dimensional Space

Event-triggered Adaptive Neural Asymptotic Tracking Control of Autonomous Underwater Vehicles

Robust Adaptive Trajectory Tracking Control of Underactuated Autonomous Underwater Vehicles with Prescribed Performance

Adaptive Sliding Mode Control for AUV based on Backstepping and Neural Networks

Adaptive SNDO-STSM Hierarchical Robust Control of Autonomous Underwater Vehicle: Theory and Experimental Validation

Adaptive neural network fixed-time sliding mode control for trajectory tracking of underwater vehicle