Abstract:This paper addresses the zero‐sum game problem for strict‐feedback nonlinear multiagent systems with full‐state constraints. Specifically, this paper focuses on the zero‐sum game scenario, wherein multiple agents aim to optimize the control strategies while considering the conflicting objectives of their opponents. To handle the full‐state constraints, a one‐to‐one nonlinear mapping technique is employed to convert the original strict‐feedback system into a more manageable pure‐feedback system without state constraints. In order to find a Nash equilibrium for virtual control signals and external disturbances, a simplified reinforcement learning algorithm is proposed, which tackles the challenges posed by solving the Hamilton–Jacobi–Isaacs equation. Unlike the existing H∞ optimal control strategies that deal with matching conditions, the H∞ optimal control strategy for strict‐feedback nonlinear systems needs to address the computational complexity issue arising from the repeated derivation of the virtual controller. To overcome the high‐order virtual controller problem, an approach based on the dynamic surface technique is introduced. By incorporating an approximation term of the high‐order virtual controller into the value function, the computational complexity challenge is effectively resolved. Based on the Lyapunov stability theorem, it is proved that all signals of the closed‐loop systems are semi‐global uniformly ultimately bounded and the tracking control performance can be guaranteed. Finally, simulation results are given to verify the effectiveness of the proposed control strategy.

Zero‐sum game for nonlinear multiagent systems with full‐state constraints

Distributed zero-sum differential game for multi-agent systems in strict-feedback form with input saturation and output constraint

Game-Based Backstepping Design for Strict-Feedback Nonlinear Multi-Agent Systems Based on Reinforcement Learning

Non‐zero‐sum games of discrete‐time Markov jump systems with unknown dynamics: An off‐policy reinforcement learning method

An efficient model‐free adaptive optimal control of continuous‐time nonlinear non‐zero‐sum games based on integral reinforcement learning with exploration

A novel Z-function-based completely model-free reinforcement learning method to finite-horizon zero-sum game of nonlinear system

Zero-Sum Game-Based Decentralized Optimal Control for Saturated Nonlinear Interconnected Systems via a Data and Event Driven Approach

Zeroth-Order Feedback Optimization for Cooperative Multi-Agent Systems

Zeroth-Order Feedback Optimization in Multi-Agent Systems: Tackling Coupled Constraints

Two-Player Zero-Sum Hybrid Games

Zero‐sum game‐based H∞ optimal finite‐time prescribed performance control for nonlinear multiagent systems with actuator faults

Zero-Sum Differential Game-Based Fault-Tolerant Control for a Class of Affine Nonlinear Systems

A zero-sum hybrid stochastic differential game with impulse controls

Bipartite Containment Control of Multi-Agent Systems Subject to Adversarial Inputs Based on Zero-Sum Game

Linear-quadratic zero-sum mean-field type games: Optimality conditions and policy optimization

Relaxed Policy Iteration Algorithm for Nonlinear Zero-Sum Games with Application to H-infinity Control

Neural-network-based safe learning control for non-zero-sum differential games of nonlinear systems with asymmetric input constraints

Nonzero-Sum Games Using Actor-Critic Neural Networks: A Dynamic Event-Triggered Adaptive Dynamic Programming

Observer-based event-triggered control for zero-sum games of input constrained multi-player nonlinear systems

Data‐based distributed consensus optimal control for nonlinear multi‐agent systems under switching topology

Approximate-optimal control algorithm for constrained zero-sum differential games through event-triggering mechanism