Abstract:In this paper, an adaptive tracking control scheme is designed for a class of continuous-time uncertain nonlinear systems based on the approximate solution of the Hamilton–Jacobi–Bellman (HJB) equation. Considering matched uncertainties, the tracking control of the continuous-time uncertain nonlinear system can be transformed to the optimal tracking control of the associated nominal system. By building the nominal error system and modifying its cost function, the solution of the relevant HJB equation can be contributed to the adaptive tracking control of the continuous-time uncertain nonlinear system. In view of the complexity on solving the HJB equation, its approximate solution is pursued by the policy iteration algorithm under the adaptive dynamic programming (ADP) framework, where a critic neural network is constructed to approximate the optimal cost function, and an action network is used to directly calculate the approximate optimal control law, which constitutes the tracking control law for the original uncertain system together with the steady control law. The weight convergence of the critic network and the stability of the closed-loop system are provided as the theoretical guarantee based on the Lyapunov theory. Two simulation examples are studied to verify the theoretical results and the effectiveness of the proposed tracking control scheme.

Event-Triggered H∞ Tracking Control of Nonlinear Systems Via Reinforcement Learning Method.

A Learning-Based Optimal Tracking Controller for Continuous Linear Systems with Unknown Dynamics: Theory and Case Study

Data-Driven Finite-Horizon $H_{}$ Tracking Control With Event-Triggered Mechanism for the Continuous-Time Nonlinear Systems

H ∞ Reference Tracking Control Design for a Class of Nonlinear Systems with Time-Varying Delays

H∞ Tracking Control for Linear Discrete‐time Systems Via Reinforcement Learning

Model-Free H∞ Optimal Tracking Control of Constrained Nonlinear Systems Via an Iterative Adaptive Learning Algorithm

H∞$$ {h}_{\infty } $$ Optimal Output Tracking Control for Markov Jump Systems: A Reinforcement Learning‐based Approach

Learning-Based Event-Triggered Tracking Control for Nonlinear Networked Control Systems with Unmatched Disturbance

Event-driven H ∞ control with critic learning for nonlinear systems

Event-Triggered Reinforcement Learning-Based Adaptive Tracking Control for Completely Unknown Continuous-Time Nonlinear Systems

Approximate Optimal Event-Triggered Control of Discounted-Cost Nonlinear Systems

H∞ Control with Constrained Input for Completely Unknown Nonlinear Systems Using Data-Driven Reinforcement Learning Method

Adaptive Tracking Control for a Class of Continuous-Time Uncertain Nonlinear Systems Using the Approximate Solution of HJB Equation.

Event-Driven H ∞ -Constrained Control Using Adaptive Critic Learning

Event-trigger-based Robust Control for Nonlinear Constrained-Input Systems Using Reinforcement Learning Method

Event-Triggered Optimal Tracking Control for Strict-Feedback Nonlinear Systems With Non-Affine Nonlinear Faults

Event-triggered Reinforcement Learning H∞ Control Design for Constrained-Input Nonlinear Systems Subject to Actuator Failures.

Fuzzy Adaptive Tracking of Constrained Nonlinear Systems with Event-Sampling Reinforcement Learning

Adaptive Dynamic Programming for Tracking Design of Uncertain Nonlinear Systems with Disturbances and Input Constraints

Adaptive Critic Learning for Approximate Optimal Event-Triggered Tracking Control of Nonlinear Systems with Prescribed Performances

Optimal H∞ Tracking Control of Nonlinear Systems with Zero-Equilibrium-free Via Novel Adaptive Critic Designs.