Abstract:This paper proposes a joint optimization strategy for nonlinear systems subject to unknown external disturbances. The co-design problem is formulated as a two-player zero-sum game, where the control policy is treated as the first player and the control input error caused by aperiodic feedback is treated as the second player. Besides, a robust term is incorporated to the performance index to suppress the negative effect of external disturbances. Based on the game theory, the optimal performance index and the solution to the associated Hamilton–Jacobi–Isaacs (HJI) equation can be obtained. Then, the sampling intervals are optimized by designing an event-triggered condition according to Lyapunov direct method. Furthermore, a self-triggered strategy is introduced to predict the next triggering instant in advance, avoiding the requirement of continuous state measurements. Through critic-only neural network (NN) implementation, the event-based HJI equation is approximated by using adaptive dynamic programming technique. The closed-loop nonlinear system and the weight estimation error for the critic NN are both guaranteed to be uniformly ultimately bounded under the proposed aperiodic sampling mechanism. Finally, simulation results and comparison studies demonstrate the effectiveness of the proposed co-design approach.

Optimal H∞ Control of Nonlinear Systems Via Static and Dynamic Triggering Critic Learning

A Learning-Based Optimal Tracking Controller for Continuous Linear Systems with Unknown Dynamics: Theory and Case Study

Event-driven H ∞ control with critic learning for nonlinear systems

Optimal H∞ Tracking Control of Nonlinear Systems with Zero-Equilibrium-free Via Novel Adaptive Critic Designs.

Optimal Event-Triggered $h_{\infty}$ Control for Nonlinear Systems with Completely Unknown Dynamics

Neural Network-Based Adaptive Critic Control for Saturated Nonlinear Systems With Full State Constraints via a Novel Event-Triggered Mechanism

Event-Driven H ∞ -Constrained Control Using Adaptive Critic Learning

Adaptive Critic Learning for Constrained Optimal Event-Triggered Control With Discounted Cost

Triggering and Control Co-design of Nonlinear Systems with External Disturbances Using Adaptive Dynamic Programming

On Mixed Data and Event Driven Design for Adaptive-Critic-Based Nonlinear $h_{\infty}$ Control

Event-Triggered Optimal Tracking Control Design with DHP Formulation for Discrete-Time Nonlinear Nonzero-Sum Games

Event-Triggered Optimal Tracking Control for Strict-Feedback Nonlinear Systems With Non-Affine Nonlinear Faults

Quantized optimal output feedback control and optimal triggering signal co‐design for unknown discrete‐time nonlinear systems

Event-triggered Receding Horizon Control Via Actor-Critic Design

H∞$$ {h}_{\infty } $$ Optimal Output Tracking Control for Markov Jump Systems: A Reinforcement Learning‐based Approach

Model-free Adaptive Dynamic Programming for Optimal Control of Discrete-time Affine Nonlinear System

Event-Triggered Adaptive Dynamic Programming for Continuous-Time Systems with Control Constraints

Online actor‐critic learning control with self‐triggered mechanism for nonlinear regulation problems

Event‐triggered optimal tracking control of multiplayer unknown nonlinear systems via adaptive critic designs

Event-triggered optimal control with finite-time convergence critic networks for input-constrained nonlinear systems

Approximate-optimal control algorithm for constrained zero-sum differential games through event-triggering mechanism