Abstract:A mixed adaptive dynamic programming (ADP) scheme based on zero-sum game theory is developed to address optimal control problems of autonomous underwater vehicle (AUV) systems subject to disturbances and safe constraints. By combining prior dynamic knowledge and actual sampled data, the proposed approach effectively mitigates the defect caused by the inaccurate dynamic model and significantly improves the training speed of the ADP algorithm. Initially, the dataset is enriched with sufficient reference data collected based on a nominal model without considering modelling bias. Also, the control object interacts with the real environment and continuously gathers adequate sampled data in the dataset. To comprehensively leverage the advantages of model-based and model-free methods during training, an adaptive tuning factor is introduced based on the dataset that possesses model-referenced information and conforms to the distribution of the real-world environment, which balances the influence of model-based control law and data-driven policy gradient on the direction of policy improvement. As a result, the proposed approach accelerates the learning speed compared to data-driven methods, concurrently also enhancing the tracking performance in comparison to model-based control methods. Moreover, the optimal control problem under disturbances is formulated as a zero-sum game, and the actor-critic-disturbance framework is introduced to approximate the optimal control input, cost function, and disturbance policy, respectively. Furthermore, the convergence property of the proposed algorithm based on the value iteration method is analysed. Finally, an example of AUV path following based on the improved line-of-sight guidance is presented to demonstrate the effectiveness of the proposed method.

Path Following Control of Fully-Actuated Autonomous Underwater Vehicle in Presence of Fast-Varying Disturbances

Improved Line-of-sight Nonlinear Trajectory Tracking Control of Autonomous Underwater Vehicle Exposed to High Variable Speed Ocean Currents

Active Disturbance Rejection Control of Underwater Vehicles under External Disturbances

Path following controller for unmanned surface vessels based on ADRC

Hovering Depth Controller for AUV Based on Active Disturbances Rejection Controller

Active disturbance rejection control based path following of underactuated surface ships

Motion Control of Autonomous Underwater Vehicle Based on Fractional Calculus Active Disturbance Rejection

USV Trajectory Tracking Control System Based on ADRC

Path Following Based on Waypoints and Real-Time Obstacle Avoidance Control of an Autonomous Underwater Vehicle

Active Disturbance Rejection Controller Based Heading Control of Underwater Flight Vehicles

Motion Control of Autonomous Underwater Helicopter Based on Linear Active Disturbance Rejection Control with Tracking Differentiator

Application of Linear Active Disturbance Rejection Control in Autonomous Underwater Vehicle Robot

Fuzzy Optimized MFAC Based on ADRC in AUV Heading Control

Soft Actor–Critic Based Active Disturbance Rejection Path Following Control for Unmanned Surface Vessel under Wind and Wave Disturbances

Active disturbance rejection control for AUV pitch angle

Data-Driven Based Active Disturbance Rejection Control for Underwater Vehicle Manipulator System

Active Disturbance Rejection Control of Path Following Control for Autonomous Ground Vehicles

A Hierarchical Disturbance Rejection Depth Tracking Control of Underactuated AUV with Experimental Verification

Learning-based Tracking Control of AUV: Mixed Policy Improvement and Game-Based Disturbance Rejection

ADRC-Based Underwater Navigation Control and Parameter Tuning of an Amphibious Multirotor Vehicle

Three-Dimensional Path Following of an Underactuated AUV Based on Neuro-Adaptive Command Filtered Backstepping Control