Abstract:This paper addresses the zero‐sum game problem for strict‐feedback nonlinear multiagent systems with full‐state constraints. Specifically, this paper focuses on the zero‐sum game scenario, wherein multiple agents aim to optimize the control strategies while considering the conflicting objectives of their opponents. To handle the full‐state constraints, a one‐to‐one nonlinear mapping technique is employed to convert the original strict‐feedback system into a more manageable pure‐feedback system without state constraints. In order to find a Nash equilibrium for virtual control signals and external disturbances, a simplified reinforcement learning algorithm is proposed, which tackles the challenges posed by solving the Hamilton–Jacobi–Isaacs equation. Unlike the existing H∞ optimal control strategies that deal with matching conditions, the H∞ optimal control strategy for strict‐feedback nonlinear systems needs to address the computational complexity issue arising from the repeated derivation of the virtual controller. To overcome the high‐order virtual controller problem, an approach based on the dynamic surface technique is introduced. By incorporating an approximation term of the high‐order virtual controller into the value function, the computational complexity challenge is effectively resolved. Based on the Lyapunov stability theorem, it is proved that all signals of the closed‐loop systems are semi‐global uniformly ultimately bounded and the tracking control performance can be guaranteed. Finally, simulation results are given to verify the effectiveness of the proposed control strategy.

A novel Z-function-based completely model-free reinforcement learning method to finite-horizon zero-sum game of nonlinear system

An efficient model‐free adaptive optimal control of continuous‐time nonlinear non‐zero‐sum games based on integral reinforcement learning with exploration

Integral Reinforcement Learning for Linear Continuous-Time Zero-Sum Games With Completely Unknown Dynamics

Model‐free Adaptive Optimal Control of Continuous‐time Nonlinear Non‐zero‐sum Games Based on Reinforcement Learning

Solving the Zero-Sum Control Problem for Tidal Turbine System: an Online Reinforcement Learning Approach

A New Iteration Approach To Solve A Class Of Finite-Horizon Continuous-Time Nonaffine Nonlinear Zero-Sum Game

Model-free Finite-Horizon Optimal Control of Discrete-Time Two-Player Zero-Sum Games.

Q-Learning for Feedback Nash Strategy of Finite-Horizon Nonzero-Sum Difference Games

Model-Free Temporal Difference Learning For Non-Zero-Sum Games

Zero‐sum game for nonlinear multiagent systems with full‐state constraints

Discrete-Time Non-Zero-Sum Games With Completely Unknown Dynamics

Off-policy Synchronous Iteration IRL Method for Multi-Player Zero-Sum Games with Input Constraints

Data-Driven Nonzero-Sum Game for Discrete-Time Systems Using Off-Policy Reinforcement Learning

Integral Reinforcement Learning Off-Policy Method for Solving Nonlinear Multi-Player Nonzero-Sum Games with Saturated Actuator.

Optimal Tracking Control for Non-Zero-sum Games of Linear Discrete-Time Systems Via Off-Policy Reinforcement Learning

Integral Policy Iteration for Zero-Sum Games with Completely Unknown Nonlinear Dynamics

Event-triggered Adaptive Integral Reinforcement Learning Method for Zero-Sum Differential Games of Nonlinear Systems with Incomplete Known Dynamics

Neural-network-based Zero-Sum Game for Discrete-Time Nonlinear Systems Via Iterative Adaptive Dynamic Programming Algorithm

Novel single-loop policy iteration for linear zero-sum games

Off-Policy Integral Reinforcement Learning Method to Solve Nonlinear Continuous-Time Multiplayer Nonzero-Sum Games.

Reinforcement Learning Based Solution To Two-Player Zero-Sum Game Using Differentiator