Abstract:This paper integrates game theory, optimal control theory and reinforcement learning to deal with the discrete-time (DT) multi-player non-zero-sum game issue. As is known, the solutions to non-zero-sum game problems are the outcomes of coupled Riccati equations or coupled Hamilton–Jacobi ones, which are generally difficult to solve analytically and require the knowledge of accurate system mathematical models. However, for most practical industrial systems, the system dynamics cannot be obtained accurately or even unavailable, and the conventional model-based methods will be invalid. To overcome this deficiency, we develop data-based adaptive dynamic programming (ADP) algorithms for completely unknown multi-player systems. Firstly, the Nash equilibrium and stationarity conditions are used to formulate the DT multi-player non-zero-sum game, and then policy iteration algorithm is applied to approximate optimal solutions successively. Secondly, a novel online ADP algorithm combined with a neural-network-based identification scheme is designed and only requires the system data instead of the real system models. Subsequently, a data-driven action-dependent heuristic dynamic programming approach is presented and circumvents the estimation errors caused by the identification learning procedure. Finally, two simulation examples are provided to illustrate the feasibility of our schemes.

Robust Adaptive Dynamic Programming for A Zero-Sum Differential Game

Robust Adaptive Dynamic Programming for A Three-Player Zero-Sum Differential Game with Unmatched Uncertainties

Robust Adaptive Dynamic Programming of Two-Player Zero-Sum Games for Continuous-Time Linear Systems

Robust Zero-Sum Differential Game For Uncertain Nonlinear Systems Via Adaptive Dynamic Programming

Adaptive Dynamic Programming for Two-Player Zero-Sum Differential Games with Completely Unknown Systems

Adaptive Dynamic Programming for Solving Non-Zero-Sum Differential Games.

Model-free Adaptive Dynamic Programming for Online Optimal Solution of the Unknown Nonlinear Zero-Sum Differential Game

Distributed Zero-Sum Differential Game for Multi-Agent Nonlinear Systems Via Adaptive Dynamic Programming

Brief paper: An iterative adaptive dynamic programming method for solving a class of nonlinear zero-sum differential games

Online Iterative Adaptive Dynamic Programming Approach for Solving the Zero-Sum Game for Nonlinear Continuous-Time Systems with Partially Unknown Dynamics

Min–max adaptive dynamic programming for zero-sum differential games

Data-driven Adaptive Dynamic Programming Schemes for Non-Zero-sum Games of Unknown Discrete-Time Nonlinear Systems

Zero-sum differential games for nonlinear systems using adaptive dynamic programming with input constraint

Differential Dynamic Programming for Finite-Horizon Multi-Player Non-Zero-Sum Differential Games of Nonlinear Systems

Differential Dynamic Programming for Finite-Horizon Zero-Sum Differential Games of Nonlinear Systems

Off-policy Based Adaptive Dynamic Programming Method for Nonzero-Sum Games on Discrete-Time System

Discrete-Time Nonzero-Sum Games for Multiplayer Using Policy-Iteration-Based Adaptive Dynamic Programming Algorithms

Learning Algorithms For Differential Games Of Continuous-Time Systems

Event-Triggered Adaptive Dynamic Programming for Continuous-Time Nonlinear Two-Player Zero-Sum Game

Adaptive Dynamic Programming for a Nonlinear Two‐Player Non‐Zero‐Sum Differential Game With State and Input Constraints

Near-Optimal Control for Nonzero-Sum Differential Games of Continuous-Time Nonlinear Systems Using Single-Network Adp