Abstract:This paper focuses on the optimal output synchronization control problem of heterogeneous multiagent systems (HMASs) subject to nonidentical communication delays by a reinforcement learning method. Compared with existing studies assuming that the precise model of the leader is globally or distributively accessible to all or some of the followers, the leader's precise dynamical model is entirely inaccessible to all the followers in this paper. A data-based learning algorithm is first proposed to reconstruct the leader's unknown system matrix online. A distributed predictor subject to communication delays is further devised to estimate the leader's state, where interaction delays are allowed to be nonidentical. Then, a learning-based local controller, together with a discounted performance function, is projected to reach the optimal output synchronization. Bellman equations and game algebraic Riccati equations are constructed to learn the optimal solution by developing a model-based reinforcement learning (RL) algorithm online without solving regulator equations, which is followed by a model-free off-policy RL algorithm to relax the requirement of all agents' dynamics faced by the model-based RL algorithm. The optimal tracking control of HMASs subject to unknown leader dynamics and communication delays is shown to be solvable under the proposed RL algorithms. Finally, the effectiveness of theoretical analysis is verified by numerical simulations.

Optimal model-free output synchronization of heterogeneous systems using off-policy reinforcement learning

Optimal Model-Free Output Synchronization of Heterogeneous Multiagent Systems under Switching Topologies

Optimal output synchronization of heterogeneous multi-agent systems using measured input-output data

Input‐constrained Optimal Output Synchronization of Heterogeneous Multiagent Systems Via Observer‐based Model‐free Reinforcement Learning

Leader-Follower Output Synchronization of Linear Heterogeneous Systems with Active Leader Using Reinforcement Learning.

Output Synchronization of Nonidentical Linear Multiagent Systems.

Model-Free Cooperative Optimal Output Regulation for Linear Discrete-Time Multi-Agent Systems Using Reinforcement Learning

Adaptive output synchronization of heterogeneous network with an uncertain leader.

Robust Output Synchronisation of Non-Identical Linear Agents Via Internal Model Principle

Output Synchronization of Unknown Heterogeneous Agents Via Distributed Model Reference Adaptation

Optimal Synchronization Control of Heterogeneous Asymmetric Input-Constrained Unknown Nonlinear MASs via Reinforcement Learning

Optimal Synchronization Control of Multiagent Systems with Input Saturation Via Off-Policy Reinforcement Learning.

Observer-Based Adaptive Synchronization Control of Unknown Discrete-Time Nonlinear Heterogeneous Systems

Distributed optimal output synchronization of heterogeneous multiagent systems with communication delays

Output Synchronization of Multiple FOSMIB Power Systems

Output event-triggered tracking synchronization of heterogeneous systems on directed digraph via model-free reinforcement learning

Finite‐time adaptive output synchronization of uncertain nonlinear heterogeneous multi‐agent systems

Adaptive Output Synchronization for a Class of Uncertain Nonlinear Multi-Agent Systems over Switching Networks

Reinforcement Learning-Based Unknown Reference Tracking Control of HMASs with Nonidentical Communication Delays

Optimal Output Regulation of Linear Discrete-Time Systems with Unknown Dynamics Using Reinforcement Learning