Abstract:This paper designs a novel online event-based near-optimal control scheme for multi-player nonzero-sum (NZS) games with partially unknown system dynamics. With the introduction of event-triggered mechanism (ETM), the repetitive computing burdens and communication loads of the signals are largely alleviated. Under the event-triggered mechanism, the framework of identifier-critic is structured to solve the coupled Hamilton–Jacobi equations (CHJEs) for NZS games. A feedforward neural network (FNN) is employed to construct an identifier to learn the unknown dynamics of the nonlinear system. The critic network for each player utilizes a modified tuning law, which is composed of three terms, to seek for the approximated optimal control schemes. Besides the conventional term derived from the gradient descent method, the second term derived from the experience replay (ER) technique utilizes the historical state data to update the critic network weight vector so as to remove the persistence of excitation (PE) condition. In addition, a novel term is added to stabilize the closed-loop systems. Owing to the stabilizing term, there is no need for the initial stabilizing control. In theory, the uniform ultimate boundedness (UUB) properties of the system states and the critic network weight errors are proved by utilizing Lyapunov theorem. Furthermore, the minimal intersample time is proved to be lower bounded with a positive constant which means that the Zeno behavior is excluded during the learning phases. Finally, we show the validity of the designed algorithm via simulating two examples.

Online Event-Triggered Adaptive Critic Design for Non-Zero-sum Games of Partially Unknown Networked Systems

Online Event-Based Adaptive Critic Design with Experience Replay to Solve Partially Unknown Multi-Player Nonzero-Sum Games

Online Event-Triggered Adaptive Critic Design for Multi-Player Zero-Sum Games of Partially Unknown Nonlinear Systems with Input Constraints

Online Event-Triggered Control of Partially Unknown Networked Systems Via Adaptive Dynamic Programming

Event-Triggered Adaptive Dynamic Programming for Non-Zero-Sum Games of Unknown Nonlinear Systems Via Generalized Fuzzy Hyperbolic Models

Event-Triggered Adaptive Dynamic Programming Algorithm for Non-Zero-Sum Games of Unknown Nonlinear Systems via Generalized Fuzzy Hyperbolic Models

Online Dual-Network-Based Adaptive Dynamic Programming for Solving Partially Unknown Multi-Player Non-Zero-Sum Games with Control Constraints

Integral Reinforcement Learning-Based Online Adaptive Event-Triggered Control for Non-Zero-sum Games of Partially Unknown Nonlinear Systems.

Decentralized Event-Triggered Adaptive Control of Discrete-Time Nonzero-Sum Games over Wireless Sensor-Actuator Networks with Input Constraints.

Robust Adaptive Critic Control Design with Network-Based Event-Triggered Formulation

Event‐triggered optimal tracking control of multiplayer unknown nonlinear systems via adaptive critic designs

Nonzero-Sum Games Using Actor-Critic Neural Networks: A Dynamic Event-Triggered Adaptive Dynamic Programming

Model-Free Adaptive Optimal Control for Unknown Nonlinear Multiplayer Nonzero-Sum Game

Event-triggered Adaptive Dynamic Programming for Multi-Player Zero-Sum Games with Unknown Dynamics

Online Reinforcement Learning-based Neural Network Controller Design for Affine Nonlinear Discrete-time Systems.

Online Event-Triggered Adaptive Optimal Control of Nonlinear Large-Scale Systems

Decentralized Event-Triggered Online Adaptive Control of Unknown Large-Scale Systems Over Wireless Communication Networks

Neural Network-Based Adaptive Critic Control for Saturated Nonlinear Systems With Full State Constraints via a Novel Event-Triggered Mechanism

Event-Triggered ADP for Nonzero-Sum Games of Unknown Nonlinear Systems

Adaptive Critic Designs for Event-Triggered Robust Control of Nonlinear Systems with Unknown Dynamics

Adaptive-Critic Design for Decentralized Event-Triggered Control of Constrained Nonlinear Interconnected Systems Within an Identifier-Critic Framework