Abstract:This paper employs an integral reinforcement learning (IRL) method to investigate the optimal tracking control problem (OTCP) for nonlinear nonzero-sum (NZS) differential game systems with unknown drift dynamics. Unlike existing methods, which can only bound the tracking error, the proposed approach ensures that the tracking error asymptotically converges to zero. This study begins by constructing an augmented system using the tracking error and reference signal, transforming the original OTCP into solving the coupled Hamilton–Jacobi (HJ) equation of the augmented system. Because the HJ equation contains unknown drift dynamics and cannot be directly solved, the IRL method is utilized to convert the HJ equation into an equivalent equation without unknown drift dynamics. To solve this equation, a critic neural network (NN) is employed to approximate the complex value function based on the tracking error and reference information data. For the unknown NN weights, the least squares (LS) method is used to design an estimation law, and the convergence of the weight estimation error is subsequently proven. The approximate solution of optimal control converges to the Nash equilibrium, and the tracking error asymptotically converges to zero in the closed system. Finally, we validate the effectiveness of the proposed method in this paper based on MATLAB using the ode45 method and least squares method to execute Algorithm 2.

Output Feedback Adaptive Dynamic Programming for Linear H∞ Tracking Control

Output Feedback Adaptive Robust Learning Control of a Class of Nonlinear Systems with Periodic Disturbances

A Learning-Based Optimal Tracking Controller for Continuous Linear Systems with Unknown Dynamics: Theory and Case Study

The Adaptive Optimal Output Feedback Tracking Control of Unknown Discrete-Time Linear Systems Using a Multistep Q-Learning Approach

H∞ Tracking Control for Linear Discrete-Time Systems: Model-Free Q-Learning Designs

H ∞ Reference Tracking Control Design for a Class of Nonlinear Systems with Time-Varying Delays

Data-Efficient Off-Policy Learning for Distributed Optimal Tracking Control of HMAS with Unidentified Exosystem Dynamics.

Reinforcement Learning Tracking Control for Unknown Continuous Dynamic Systems

Near Optimal Neural Network-based Output Feedback Control of Affine Nonlinear Discrete-Time Systems

Output-feedback Q-learning for discrete-time linear H-infinity tracking control: A Stackelberg game approach

Output‐feedback Q‐learning for discrete‐time linear <i>H</i><sup>∞</sup> tracking control: A Stackelberg game approach

Integral Reinforcement Learning-Based Optimal Output Feedback Control for Linear Continuous-Time Systems with Input Delay

Output Tracking for Nonlinear Stochastic Systems by Iterative Learning Control.

Optimal dynamic output feedback control of unknown linear continuous-time systems by adaptive dynamic programming

Output Feedback Tracking Control for Nonlinear Time-Delay Systems with Tracking Errors and Input Constraints

Reinforcement Learning for Finite-Horizon H∞ Tracking Control of Unknown Discrete Linear Time-Varying System

Output Tracking Control Based on Adaptive Dynamic Programming with Multistep Policy Evaluation

Optimal Asymptotic Tracking Control for Nonzero-Sum Differential Game Systems with Unknown Drift Dynamics via Integral Reinforcement Learning

Iterative Learning Control for Output Tracking of Nonlinear Systems with Unavailable State Information

Data-Driven H∞ Optimal Output Feedback Control for Linear Discrete-Time Systems Based on Off-Policy Q-Learning

Data-Driven Based Optimal Output-Feedback Control of Continuous-Time Systems