Abstract:This paper designs a novel online event-based near-optimal control scheme for multi-player nonzero-sum (NZS) games with partially unknown system dynamics. With the introduction of event-triggered mechanism (ETM), the repetitive computing burdens and communication loads of the signals are largely alleviated. Under the event-triggered mechanism, the framework of identifier-critic is structured to solve the coupled Hamilton–Jacobi equations (CHJEs) for NZS games. A feedforward neural network (FNN) is employed to construct an identifier to learn the unknown dynamics of the nonlinear system. The critic network for each player utilizes a modified tuning law, which is composed of three terms, to seek for the approximated optimal control schemes. Besides the conventional term derived from the gradient descent method, the second term derived from the experience replay (ER) technique utilizes the historical state data to update the critic network weight vector so as to remove the persistence of excitation (PE) condition. In addition, a novel term is added to stabilize the closed-loop systems. Owing to the stabilizing term, there is no need for the initial stabilizing control. In theory, the uniform ultimate boundedness (UUB) properties of the system states and the critic network weight errors are proved by utilizing Lyapunov theorem. Furthermore, the minimal intersample time is proved to be lower bounded with a positive constant which means that the Zeno behavior is excluded during the learning phases. Finally, we show the validity of the designed algorithm via simulating two examples.

Data-Driven Optimal Control for Multi-Player Non-Zero-Sum Games with Unknown Dynamics

Data-based Approximate Optimal Control for Nonzero-Sum Games of Multi-Player Systems Using Adaptive Dynamic Programming.

Model-Free Adaptive Optimal Control for Unknown Nonlinear Multiplayer Nonzero-Sum Game

Event-triggered Adaptive Dynamic Programming for Multi-Player Zero-Sum Games with Unknown Dynamics

Data-driven Adaptive Dynamic Programming Schemes for Non-Zero-sum Games of Unknown Discrete-Time Nonlinear Systems

Data-driven Approximate Optimal Tracking Control Schemes for Unknown Non-Affine Non-Linear Multi-Player Systems Via Adaptive Dynamic Programming

Online Optimal Solutions for Multi-Player Nonzero-Sum Game with Completely Unknown Dynamics

Online Finite-Horizon Optimal Learning Algorithm for Nonzero-Sum Games with Partially Unknown Dynamics and Constrained Inputs

Optimal and Stable Control for Two-Player Zero-Sum Game Using Adaptive Dynamic Programming

Online Dual-Network-Based Adaptive Dynamic Programming for Solving Partially Unknown Multi-Player Non-Zero-Sum Games with Control Constraints

Data-Based Online Optimal Control for Multi-player Nonlinear Non-zero-Sum Games Using Recursive Least Squares

Near-Optimal Control for Nonzero-Sum Differential Games of Continuous-Time Nonlinear Systems Using Single-Network Adp

Online Event-Triggered Adaptive Critic Design for Multi-Player Zero-Sum Games of Partially Unknown Nonlinear Systems with Input Constraints

Neural Network Optimal Control for Nonlinear System Based on Zero-Sum Differential Game.

Neural network-based near-optimal control for nonlinear discrete-time zero-sum differential games associated with the H∞ control problem

Data-Driven Zero-Sum Neuro-Optimal Control for a Class of Continuous-Time Unknown Nonlinear Systems with Disturbance Using ADP

Iterative Adaptive Dynamic Programming Methods with Neural Network Implementation for Multi-Player Zero-Sum Games

Online Event-Based Adaptive Critic Design with Experience Replay to Solve Partially Unknown Multi-Player Nonzero-Sum Games

Data-driven Adaptive Dynamic Programming for Partially Observable Nonzero-Sum Games Via Q-learning Method

Model-free Adaptive Dynamic Programming for Optimal Control of Discrete-time Affine Nonlinear System

Data-based Optimal Control for Discrete-time Zero-sum Games of 2-D Systems Using Adaptive Critic Designs