Abstract:This article proposes an optimal-distributed control protocol for multivehicle systems with an unknown switching communication graph. The optimal-distributed control problem is formulated to differential graphical games, and the Pareto optimum to multiplayer games is sought based on the viability theory and reinforcement learning techniques. The viability theory characterizes the controllability of a wide range of constrained nonlinear systems; and the viability kernel and the capture basin are the pillars of the viability theory. The capture basin is the set of all initial states, in which there exist control strategies that enable the states to reach the target in finite time while remaining inside a set before reaching the target. In this regard, the feasible learning region is characterized by the reinforcement learner. In addition, the approximation of the capture basin provides the learner with prior knowledge. Unlike the existing works that employ the viability theory to solve control problems with only one agent and differential games with only two players, the viability theory, in this article, is utilized to solve multiagent control problems and multiplayer differential games. The distributed control law is composed of two parts: 1) the approximation of the capture basin and 2) reinforcement learning, which are computed offline and online, respectively. The convergence properties of the parameters' estimation errors in reinforcement learning are proved, and the convergence of the control policy to the Pareto optimum of the differential graphical game is discussed. The guaranteed approximation results of the capture basin are provided and the simulation results of the differential graphical game are provided for multivehicle systems with the proposed distributed control policy.

Differential graphical games of multiagent systems with nonzero leader's control input and external disturbances

Consensus Seeking in Multi-Agent Systems with an Active Leader and Communication Delays.

Distributed Differential Games for Control of Multi-Agent Systems

Robust distributed Nash equilibrium solution for multi‐agent differential graphical games

Differential Graphical Games for Constrained Autonomous Vehicles Based on Viability Theory

Distributed zero-sum differential game for multi-agent systems in strict-feedback form with input saturation and output constraint

Distributed Differential Graphical Game for Control of Double-Integrator Multi-Agent Systems with Input Delay

Differential graphical game‐based multi‐agent tracking control using integral reinforcement learning

A game theoretic approach for the distributed control of multi-agent systems under directed and time-varying topology

Adaptive Distributed Tracking Control for Markov Jump Multiagent Systems with a Non-Strict Leader

A linear-quadratic partially observed Stackelberg stochastic differential game with multiple followers and its application to multi-agent formation control

Distributed Finite-Time Tracking Control For Nonlinear Multi-Agent Systems Subject To External Disturbances

Robust Control for Multiplayer Nonzero‐Sum Differential Games With Switching Topology and Input Delay

Adaptive tracking control of leader-following linear multi-agent systems with external disturbances.

Distributed Output Feedback Consensus Tracking Prescribed Performance Control for A Class of Non-Linear Multi-Agent Systems with Unknown Disturbances

Disturbance-Observer-Based Model Predictive Control for Discrete-Time Noncooperative Game over Undirected Graph

Distributed Containment Control of Linear Multi-Agent Systems with Multiple Leaders of Bounded Unknown Inputs

Distributed Tracking Control for Linear Multiagent Systems with A Leader of Bounded Unknown Input

Finite-horizon robust formation-containment control of multi-agent networks with unknown dynamics

Coordinated Tracking Of Multi-Agent Systems With A Leader Of Bounded Unknown Input Using Distributed Continuous Controllers