Abstract:This paper focuses on the optimal output synchronization control problem of heterogeneous multiagent systems (HMASs) subject to nonidentical communication delays by a reinforcement learning method. Compared with existing studies assuming that the precise model of the leader is globally or distributively accessible to all or some of the followers, the leader's precise dynamical model is entirely inaccessible to all the followers in this paper. A data-based learning algorithm is first proposed to reconstruct the leader's unknown system matrix online. A distributed predictor subject to communication delays is further devised to estimate the leader's state, where interaction delays are allowed to be nonidentical. Then, a learning-based local controller, together with a discounted performance function, is projected to reach the optimal output synchronization. Bellman equations and game algebraic Riccati equations are constructed to learn the optimal solution by developing a model-based reinforcement learning (RL) algorithm online without solving regulator equations, which is followed by a model-free off-policy RL algorithm to relax the requirement of all agents' dynamics faced by the model-based RL algorithm. The optimal tracking control of HMASs subject to unknown leader dynamics and communication delays is shown to be solvable under the proposed RL algorithms. Finally, the effectiveness of theoretical analysis is verified by numerical simulations.

Tracking a High-Dimensional Active Leader of Switching Multi-Agent Systems with Communication Delays

Consensus Seeking in Multi-Agent Systems with an Active Leader and Communication Delays.

Distributed Adaptive Tracking Control for Unknown Nonlinear Networked Systems

Multi-agent Tracking of a High-Dimensional Active Leader with Switching Topology.

Distributed Observers for Tracking a Moving Target by Cooperative Multiple Agents with Time Delays

Distributed Event-Triggered Tracking Control of Multi-Agent Systems with Active Leader

Observer-Based Event-Triggered Tracking Control of Leader-Follower Systems with Time Delay

Consensus Problem of Multi-Agent Systems with an Active Leader and Time Delay

Consensus Tracking Control of Multi-Agent System with an Active Virtual Leader and Time Delays

Leader-Follower Tracking Problem for Multi-agent Systems with Directed Impulsive Communication.

Time-varying group formation-tracking control for general linear multi-agent systems with switching topologies and time-varying delays

Reinforcement Learning-Based Unknown Reference Tracking Control of HMASs with Nonidentical Communication Delays

Adaptive Tracking Control Under Switched and Fixed Topologies With a Leader's Unknow and Bounded Inputs for Linear Multi-Agent Systems

Distributed Discrete-Time Coordinated Tracking with Markovian Switching Topologies

Time-varying Formation Tracking for High-Order Multi-Agent Systems with Switching Topologies and a Leader of Bounded Unknown Input.

Active Leader Tracking Control of Multi-Agent Systems with Quantized Measurements

Distributed Fixed-Time Consensus Tracking for High-Order Uncertain Non-Linear Multi-Agent Systems with Switching Topologies

Coordinated Tracking Of Multi-Agent Systems With A Leader Of Bounded Unknown Input Using Distributed Continuous Controllers

Event‐triggered Tracking Control of Heterogeneous Multiagent Systems Based on Two Kinds of Observers with Asymmetric Delay

Distributed Adaptive Output Feedback Consensus Tracking of Uncertain Multi-Agent Systems with Communication Delays and Switching Typologies

Distributed Discrete-Time Coordinated Tracking for Networked Single-Integrator Agents under A Markovian Switching Topology