Abstract:This paper investigates a novel adaptive fixed-time disturbance observer (AFXDO)-based approximate optimal tracking control architecture for nonlinear systems with partially unknown dynamic drift and perturbation under an adaptive dynamic programming (ADP) scheme. To attenuate the impact of disturbance, a novel AFXDO was designed based on the principle of a fixed-time stable system without prior information of disturbance, making disturbance observer errors converge to zero in a fixed time independent of initial estimation error. Additionally, approximate optimal control is conducted by incorporating the real-time estimation of AFXDO into a critic-only ADP framework to stabilize the dynamics of tracking errors and strike a balance between consumption and performance. In particular, to address the heavy calculation burden and oscillation phenomenon in the traditional actor–critic structure, an improved adaptive update law with a variable learning rate was developed to update the weight for adjusting the optimal cost function and optimal control policy simultaneously, avoiding the initial chattering phenomenon and achieving a prescribed convergence without resorting to dual networks. With the efforts of AFXDO and a weight law with a variable learning rate, the track errors were achieved with fast transient performance and low control consumptions in a fixed time. By revisiting Lyapunov stability, the tracking error and weight estimation error were proven to be uniformly ultimately bounded, and the designed control tended to optimal control. The simulations were carried out on quadrotor tracking to demonstrate the effectiveness of the developed control scheme, which achieves rapid convergence by lower control consumption in 4 s, where the cost function is reduced by 19.13%.

Approximation-Error-ADP-Based Optimal Tracking Control for Chaotic Systems

Finite‐Horizon Ε‐optimal Tracking Control of Discrete‐Time Linear Systems Using Iterative Approximate Dynamic Programming

Optimal Tracking Control for Uncertain Nonlinear Systems with Prescribed Performance Via Critic-Only ADP

Optimal Tracking Control for Linear Discrete-Time Stochastic System Based on Adaptive Dynamic Programming

Decentralized optimal tracking control for large-scale nonlinear systems with tracking error constraints

Finite Horizon Robust Optimal Tracking Control Based on Approximate Dynamic Programming for Switched Systems with Uncertainties

ADP-Based Robust Tracking Control for a Class of Nonlinear Systems With Unmatched Uncertainties

Asymptotic Tracking Controller Design for Nonlinear Systems with Guaranteed Performance.

Linear Quadratic Tracking Control of Unknown Discrete-Time Systems Using Value Iteration Algorithm

Approximate Optimal Tracking Control For A Class Of Nonlinear Systems With Disturbances

Incremental Adaptive Dynamic Programming for Approximate Optimal Tracking Control: a Decoupled and Model-Free Approach

Time-Delayed Data Informed Reinforcement Learning for Approximate Optimal Tracking Control

Near optimal tracking control of a class of nonlinear systems and an experimental comparison

Approximate Optimal Tracking Control for Partially Unknown Nonlinear Systems via an Adaptive Fixed-Time Observer

Adaptive Tracking Control for a Class of Continuous-Time Uncertain Nonlinear Systems Using the Approximate Solution of HJB Equation.

Optimal Tracking Control for a Class of Unknown Discrete-time Systems with Actuator Saturation Via Data-based ADP Algorithm

Adaptive tracking control of a class of uncertain chaotic systems in the presence of random perturbations

Robust Approximate Optimal Trajectory Tracking Control for Quadrotors

Time Delay System Tracking Control Based on ADP Iterative Algorithm

Adaptive tracking control for a class of uncertain chaotic systems

Adaptive Critic Learning for Approximate Optimal Event-Triggered Tracking Control of Nonlinear Systems with Prescribed Performances