Abstract:The standoff tracking control of underwater glider to moving targets has non-negligible potentials in oceanic observations. To perform such operations, this study presents an in-tegrated standoff tracking method that focuses on dealing with the coupled motions and under-actuated characteristics of the gliders as well as offsetting the dilemma caused by lacking of navigation system. The proposed approach contains guidance algorithm, basic controller, and reinforcement learning optimizer to improve the tracking accuracy. The ver-ified simulation model for the OUC-III glider is utilized to develop the algorithm and eval-uate the effectiveness of tracking. The adaptive navigation law called Lyapunov guidance vector field method generates the desired heading in this framework. The guidance only requires positioning information that is accessible through dead-reckoning. For the defi-ciency that the glider's state controlled by the proportional integral differential controller can not immediately reach the required state, the reinforcement learning optimizer is in-troduced. The gliding status constitutes optimizer input while the compensating rotation signals are outputted to actuate the movable mass. The reward function of the optimizer is designed for maintaining the glider position error within 1 m with respect to the standoff circle. On this basis, the objective is set to maximize the rewards and consequently to guar-antee the best accuracy. Three reinforcement learning algorithms are adopted and tested in our proposed framework. In the training phase, the training speeds of composite meth-ods and pure reinforcement learning algorithms are compared. To test the stability, we design different types of moving targets, standoff radium and disturbance in the validation simulation, which have not appeared in the training. This study can provide patterns and solutions for the standoff tracking applications of underwater gliders. Also, it enlarges the glider's scope of deployment based on the existing hardware. (c) 2021 Elsevier Inc. All rights reserved.

Research on Constraining Strategies of Underwater Glider's Trajectory under the Influence of Ocean Currents Based on DQN Algorithm

Trajectory Tracking of an Underwater Glider in Current Based on Deep Reinforcement Learning

Path planning for underwater gliders in time-varying ocean current using deep reinforcement learning

Research on Underwater Gliders Path Tracking Based on Reinforcement Learning Algorithm

Multi-constrained Intelligent Gliding Guidance Via Optimal Control and DQN

A deep Q network assisted method for underwater gliders standoff tracking to the static target

Trajectory Control Strategies for the Underwater Glider

A Self-Searching Optimal ADRC for the Pitch Angle Control of an Underwater Thermal Glider in the Vertical Plane Motion

Gliding strategy analysis and optimisation of underwater gliders balancing energy consumption, motion accuracy and voyage velocity

Based on Deep Reinforcement Learning to Path Planning in Uncertain Ocean Currents for Underwater Gliders

Nonlinear Feedforward and Feedback Control Design for Autonomous Underwater Glider

Motion Analysis and Trajectory Simulation of Site Controllable Underwater Glider

Control Parameter Optimization Based Trajectory Design of Underwater Gliders Executing Underwater Fixed-Point Exploration Missions

Deep reinforcement learning-based path planning method for underwater gliders in unknown 3D marine environment

High-precision Motion Control of Underwater Gliders Based on Reinforcement Learning

Gliding in extreme waters: Dynamic Modeling and Nonlinear Control of an Agile Underwater Glider

An Improved DDPG Reinforcement Learning Control of Underwater Gliders for Energy Optimization

Modeling and Vertical Motion Control of Underwater Glider

Attitude Control of Underwater Glider Combined Reinforcement Learning with Active Disturbance Rejection Control

Standoff tracking control of underwater glider to moving target

Research on Motion Attitude Control of Under-actuated Autonomous Underwater Vehicle Based on Deep Reinforcement Learning