Abstract:In this article, a novel online method for multi-player non-zero-sum (NZS) differential games of nonlinear partially unknown continuous time (CT) systems with control constraints is developed based on neural networks (NN). The issue of multi-player NZS games with saturated actuator is elaborately analyzed and the unknown dynamics model is learned by applying identifier NN. Different from using the standard identifier-actor-critic framework of adaptive dynamic programming (ADP), the proposed method uses only identifier networks and critic networks for all the players to solve the coupled Hamilton-Jacobi (HJ) equations for multi-player NZS games, which could effectively simplify the algorithm and save computing resources. Moreover, a tuning law which utilizes the gradient descent method is designed for each critic network. Meanwhile, to remove the requirement for the initial stabilizing control, a novel stability term is designed to ensure the system stability during the training phase of the critic NN. By the means of Lyapunov approach, it is proven that the system states, the critic network weight estimation errors and the obtained control are all uniformly ultimately bounded (UUB). Finally, two numerical examples are simulated to illustrate the validity of the developed method for multi-player NZS games with control constraints.

Adaptive Dynamic Programming for a Nonlinear Two‐Player Non‐Zero‐Sum Differential Game With State and Input Constraints

A Nonlinear Multi-Player Non-Zero-sum Differential Game with State Constraints and Input Delay

Zero-sum differential games for nonlinear systems using adaptive dynamic programming with input constraint

Online Dual-Network-Based Adaptive Dynamic Programming for Solving Partially Unknown Multi-Player Non-Zero-Sum Games with Control Constraints

Adaptive Dynamic Programming for Solving Non-Zero-Sum Differential Games.

Distributed Zero-Sum Differential Game for Multi-Agent Nonlinear Systems Via Adaptive Dynamic Programming

Adaptive Dynamic Programming for A Nonlinear Single-Pursuer Single-Evader Differential Game

Near-Optimal Control for Nonzero-Sum Differential Games of Continuous-Time Nonlinear Systems Using Single-Network Adp

A Single-NN Iterative Adaptive Dynamic Programming Algorithm for Continuous-Time Nonlinear Zero-Sum Games

Differential Dynamic Programming for Finite-Horizon Multi-Player Non-Zero-Sum Differential Games of Nonlinear Systems

Adaptive Dynamic Programming for Two-Player Zero-Sum Differential Games with Completely Unknown Systems

Min–max adaptive dynamic programming for zero-sum differential games

Neural network-based near-optimal control for nonlinear discrete-time zero-sum differential games associated with the H∞ control problem

Approximate Solution for Three-Player Mixed-Zero-Sum Nonlinear Game via ADP Structure

Differential Dynamic Programming for Finite-Horizon Zero-Sum Differential Games of Nonlinear Systems

Brief paper: An iterative adaptive dynamic programming method for solving a class of nonlinear zero-sum differential games

Iterative Adaptive Dynamic Programming Methods with Neural Network Implementation for Multi-Player Zero-Sum Games

Event-triggered distributed zero-sum differential game for nonlinear multi-agent systems using adaptive dynamic programming

Event-triggered Adaptive Dynamic Programming for Multi-Player Zero-Sum Games with Unknown Dynamics

Finite-time Differential Game for Nonlinear Systems Using Adaptive Dynamic Programming

Robust Zero-Sum Differential Game For Uncertain Nonlinear Systems Via Adaptive Dynamic Programming