Abstract:This paper addresses the zero‐sum game problem for strict‐feedback nonlinear multiagent systems with full‐state constraints. Specifically, this paper focuses on the zero‐sum game scenario, wherein multiple agents aim to optimize the control strategies while considering the conflicting objectives of their opponents. To handle the full‐state constraints, a one‐to‐one nonlinear mapping technique is employed to convert the original strict‐feedback system into a more manageable pure‐feedback system without state constraints. In order to find a Nash equilibrium for virtual control signals and external disturbances, a simplified reinforcement learning algorithm is proposed, which tackles the challenges posed by solving the Hamilton–Jacobi–Isaacs equation. Unlike the existing H∞ optimal control strategies that deal with matching conditions, the H∞ optimal control strategy for strict‐feedback nonlinear systems needs to address the computational complexity issue arising from the repeated derivation of the virtual controller. To overcome the high‐order virtual controller problem, an approach based on the dynamic surface technique is introduced. By incorporating an approximation term of the high‐order virtual controller into the value function, the computational complexity challenge is effectively resolved. Based on the Lyapunov stability theorem, it is proved that all signals of the closed‐loop systems are semi‐global uniformly ultimately bounded and the tracking control performance can be guaranteed. Finally, simulation results are given to verify the effectiveness of the proposed control strategy.

A two-player game representation for a class of infinite horizon control problems under state constraints

Feedback and Open-Loop Nash Equilibria for LQ Infinite-Horizon Discrete-Time Dynamic Games

On Mixed H2 and H-infinite Control

Linear quadratic optimal control problems for stochastic evolution equations in infinite horizon

Linear-quadratic stochastic differential game: Infinite-time case

Risk-sensitive control, single controller games and linear programming

On extension for infinite horizon game of pursuit-evasion

Equilibrium strategies in time-inconsistent stochastic control problems with constraints: necessary conditions

Soft-constrained output feedback guaranteed cost equilibria in infinite-horizon uncertain linear-quadratic differential games

A Nash-Type Fictitious Game Framework to Time-Inconsistent Stochastic Control Problems

An Optimal Solution to Infinite Horizon Nonlinear Control Problems: Part II

Zero‐sum game for nonlinear multiagent systems with full‐state constraints

Two-person zero-sum stochastic linear quadratic control problems with Markov chains and fractional Brownian motion in infinite horizon

Linear quadratic differential game problems with constrained open-loop controls

Two person non-zero-sum linear-quadratic differential game with Markovian jumps in infinite horizon

Infinite Horizon Stackelberg Differential Games with Random Coefficients under Control Input Constraint

Generalized open-loop Nash equilibria in linear-quadratic difference games with coupled-affine inequality constraints

State feedback control design to avoid players going bankrupt

On a Linear Differential Game of Pursuit with Integral Constraints in l2

State Constrained Two Player Differential Games with Decoupled Dynamics