Soft Actor–Critic Based Active Disturbance Rejection Path Following Control for Unmanned Surface Vessel under Wind and Wave Disturbances

Yuemin Zheng,Jin Tao,Qinglin Sun,Hao Sun,Zengqiang Chen,Mingwei Sun,Guangming Xie
DOI: https://doi.org/10.1016/j.oceaneng.2022.110631
IF: 5
2022-01-01
Ocean Engineering
Abstract:The research of unmanned surface vessel (USV) path tracking has always been of great interest in maneuvering control. In the course of navigation, a USV will inevitably be affected by disturbances such as wind and waves, or the USV’s operating conditions will suddenly change. To overcome the impact of these disturbances or uncertainties is of great significance to its safe and efficient navigation. In this paper, the three-degree-of-freedom (DOF) manipulative modeling group (MMG) model is used to express the dynamic characteristics of a USV so that its motion process is closer to its real states. We consider the underactuated control problem of using rudder angles to realize the tracking control of the USV’s position and heading angle. To this end, we propose a guidance law and design a linear active disturbance rejection controller (LADRC), and the stability of the guidance law and controller are analyzed. This paper combines control and decision-making in reinforcement learning and proposes an LADRC control strategy based on soft actor–critic (SAC) algorithm to realize the adaptive control of USV path tracking. The effectiveness of the proposed method is verified by line and circle under wind and wave environments.
What problem does this paper attempt to address?