Abstract:This paper studies the cooperative tracking control problem of interacted multi‐agent systems under undirected communication. An infinite horizon cooperative differential graphical game‐theoretic tracking control framework along with a data‐driven off‐policy integral reinforcement learning scheme is proposed, where several theoretical results are rigorously established. Simulated results are conducted to validate the effectiveness of the proposed game and IRL‐based tracking control method. This paper studies the cooperative tracking control problem of interacted multi‐agent systems (MASs) under undirected communication. Based on differential graphical game theory, the MAS tracking control problem is formulated as an infinite horizon cooperative differential graphical game‐theoretic tracking control framework, where a multi‐objective optimization problem is designed and then cast into a Pareto‐equivalent single‐objective optimization problem using a scalarization method. Necessary and sufficient conditions for the existence of the Pareto‐optimal strategy to the game theoretic tracking control are established, where it has been proven that the solution to the integral Bellman optimality equation leads to Pareto‐optimal strategy. Then, an off‐policy integral reinforcement learning scheme to find optimal control strategy using a pure data‐driven manner is developed, which consumes less computation efforts than the traditional learning scheme. Simulated results are conducted to validate the effectiveness of the proposed game and IRL‐based tracking control method.

Cooperative Differential Graphical Game Theoretic for Tracking Control of Nonlinear Multi-Agent Systems with Unknown Dynamics

Differential graphical game‐based multi‐agent tracking control using integral reinforcement learning

Cooperative Path Following Control in Autonomous Vehicles Graphical Games: A Data-Based Off-Policy Learning Approach

Pareto-optimal Synchronization Control of Nonlinear Multi-Agent Systems Via Integral Reinforcement Learning

Data-Efficient Off-Policy Learning for Distributed Optimal Tracking Control of HMAS with Unidentified Exosystem Dynamics.

Distributed Optimal Control of Nonlinear Multi‐agent Systems Based on Integral Reinforcement Learning

Dual Optimization-Based Distributed Tracking Control under Completely Unknown Dynamics

Optimal self-learning cooperative control for continuous-time heterogeneous multi-agent systems

Nash Equilibrium Seeking for High-order Multi-agent Systems with Unknown Dynamics

Adaptive Cooperative Tracking Control of Uncertain Nonlinear Multiagent Systems with Uncertain Markov Switching Communication Graphs

Data-driven Approximate Optimal Tracking Control Schemes for Unknown Non-Affine Non-Linear Multi-Player Systems Via Adaptive Dynamic Programming

Distributed Differential Graphical Game for Control of Double-Integrator Multi-Agent Systems with Input Delay

Optimal Tracking Control for Multi-player Non-Zero-Sum Games of Continuous-Time Linear Systems with Unknown Dynamics.

Cyclic-Small-Gain Approach to Adaptive Control for Multiagent Systems With Unknown Interconnected Dynamics

Distributed Neural Control For Cooperative Tracking Of Uncertain Nonlinear Multi-Agent Systems Under A Directed Network

Robust Optimal Tracking Control for Multiplayer Systems by Off‐policy Q‐learning Approach

Data-Driven Tracking Control for Multi-Agent Systems with Unknown Dynamics Via Multithreading Iterative Q-Learning

Adaptive Optimal Output-Feedback Consensus Tracking Control of Nonlinear Multiagent Systems Using Two-Player Stackelberg Game

Cooperative Tracking Control for Linear Multi-Agent Systems with External Disturbances under a Directed Graph

Distributed Adaptive Output-Feedback Tracking Control of Non-Affine Multi-Agent Systems with Prescribed Performance