Abstract:The standoff tracking control of underwater glider to moving targets has non-negligible potentials in oceanic observations. To perform such operations, this study presents an in-tegrated standoff tracking method that focuses on dealing with the coupled motions and under-actuated characteristics of the gliders as well as offsetting the dilemma caused by lacking of navigation system. The proposed approach contains guidance algorithm, basic controller, and reinforcement learning optimizer to improve the tracking accuracy. The ver-ified simulation model for the OUC-III glider is utilized to develop the algorithm and eval-uate the effectiveness of tracking. The adaptive navigation law called Lyapunov guidance vector field method generates the desired heading in this framework. The guidance only requires positioning information that is accessible through dead-reckoning. For the defi-ciency that the glider's state controlled by the proportional integral differential controller can not immediately reach the required state, the reinforcement learning optimizer is in-troduced. The gliding status constitutes optimizer input while the compensating rotation signals are outputted to actuate the movable mass. The reward function of the optimizer is designed for maintaining the glider position error within 1 m with respect to the standoff circle. On this basis, the objective is set to maximize the rewards and consequently to guar-antee the best accuracy. Three reinforcement learning algorithms are adopted and tested in our proposed framework. In the training phase, the training speeds of composite meth-ods and pure reinforcement learning algorithms are compared. To test the stability, we design different types of moving targets, standoff radium and disturbance in the validation simulation, which have not appeared in the training. This study can provide patterns and solutions for the standoff tracking applications of underwater gliders. Also, it enlarges the glider's scope of deployment based on the existing hardware. (c) 2021 Elsevier Inc. All rights reserved.

High-precision Motion Control of Underwater Gliders Based on Reinforcement Learning

Nonlinear Feedforward and Feedback Control Design for Autonomous Underwater Glider

Vertical Motion Control of an Underwater Glider with a Command Filtered Adaptive Algorithm

Nonlinear Control for Autonomous Underwater Glider Motion Based on Inverse System Method

Gliding in extreme waters: Dynamic Modeling and Nonlinear Control of an Agile Underwater Glider

Attitude Control of Underwater Glider Combined Reinforcement Learning with Active Disturbance Rejection Control

Modeling and Vertical Motion Control of Underwater Glider

Trajectory Tracking of an Underwater Glider in Current Based on Deep Reinforcement Learning

A feedback control strategy for improving the motion accuracy of underwater gliders in currents: Performance analysis and parameter optimization

An Underwater Glider with Muscle-Actuated Buoyancy Control and Caudal Fin Turning

Adaptive Robust Tracking Control for Underwater Gliders with Uncertainty and Time-Varying Input Delay

Research on Motion Attitude Control of Under-actuated Autonomous Underwater Vehicle Based on Deep Reinforcement Learning

Neural Network Model-Based Reinforcement Learning Control for AUV 3-D Path Following

A Self-Searching Optimal ADRC for the Pitch Angle Control of an Underwater Thermal Glider in the Vertical Plane Motion

Position Tracking of an Autonomous Underwater Glider Based on Adaptive Filtered Backstepping Control

A General Motion Controller Based on Deep Reinforcement Learning for an Autonomous Underwater Vehicle with Unknown Disturbances.

Lightweight Modeling of Underwater Gliders and Nonlinear MPC Controller Design with Actuator Constraint

Standoff tracking control of underwater glider to moving target

The Intelligent Control System and Experiments for an Unmanned Wave Glider

A deep Q network assisted method for underwater gliders standoff tracking to the static target

Modeling and PID Control of Underwater Glider Motion