Abstract:This paper addresses the zero‐sum game problem for strict‐feedback nonlinear multiagent systems with full‐state constraints. Specifically, this paper focuses on the zero‐sum game scenario, wherein multiple agents aim to optimize the control strategies while considering the conflicting objectives of their opponents. To handle the full‐state constraints, a one‐to‐one nonlinear mapping technique is employed to convert the original strict‐feedback system into a more manageable pure‐feedback system without state constraints. In order to find a Nash equilibrium for virtual control signals and external disturbances, a simplified reinforcement learning algorithm is proposed, which tackles the challenges posed by solving the Hamilton–Jacobi–Isaacs equation. Unlike the existing H∞ optimal control strategies that deal with matching conditions, the H∞ optimal control strategy for strict‐feedback nonlinear systems needs to address the computational complexity issue arising from the repeated derivation of the virtual controller. To overcome the high‐order virtual controller problem, an approach based on the dynamic surface technique is introduced. By incorporating an approximation term of the high‐order virtual controller into the value function, the computational complexity challenge is effectively resolved. Based on the Lyapunov stability theorem, it is proved that all signals of the closed‐loop systems are semi‐global uniformly ultimately bounded and the tracking control performance can be guaranteed. Finally, simulation results are given to verify the effectiveness of the proposed control strategy.

Bipartite Containment Control of Multi-Agent Systems Subject to Adversarial Inputs Based on Zero-Sum Game

Constrained Containment Control for Multiagent Systems with Possible Empty Intersection of Position Constraints

Adaptive Bipartite Output Containment Control of Heterogeneous Multi-agent Systems Based on Output Regulation Approach

Game-Based Adaptive Fuzzy Optimal Bipartite Containment of Nonlinear Multiagent Systems

Game-based Adaptive Fuzzy Optimal Bipartite Containment of Nonlinear Multi-agent Systems

Distributed Adaptive Bipartite Containment Control of Linear Multi-agent Systems with Structurally Balanced Graph

Bipartite Containment for Linear Multi‐agent Systems Subject to Unknown Exogenous Disturbances

Bipartite containment control for discrete-time second-order multiagent systems with time-varying delays on switching signed topologies

Bipartite Fixed-Time Output Containment Control of Heterogeneous Linear Multi-Agent Systems

Bipartite Containment Tracking over Switching Signed Networks

Designing Observer-Type Controller for Containment of Discrete-Time Linear MASs over Signed Graph

Distributed bipartite output containment control of heterogeneous multi-agent systems with directed signed graphs

Fixed-Time Bipartite Containment Control of High-Order Multi-Agent Systems in the Signed Graph

Distributed Finite-time Adaptive Containment and Bipartite Containment Control for Nonlinear Multi-agent System

Bipartite containment control of nonlinear multi‐agent systems with unknown inputs and state constraints

Event-triggered optimal containment control for multi-agent systems subject to state constraints via reinforcement learning

Zero‐sum game for nonlinear multiagent systems with full‐state constraints

Adaptive bipartite output containment control of heterogeneous multi‐agent systems against FDI attacks

Constrained Containment Control for Multi-agent Systems With Possible Empty Intersection of Position Constraints

Distributed Containment Control of Uncertain Linear Multi-Agent Systems

Containment Control of Asynchronous Discrete-Time General Linear Multiagent Systems with Arbitrary Network Topology.