Abstract:This paper focuses on the optimal output synchronization control problem of heterogeneous multiagent systems (HMASs) subject to nonidentical communication delays by a reinforcement learning method. Compared with existing studies assuming that the precise model of the leader is globally or distributively accessible to all or some of the followers, the leader's precise dynamical model is entirely inaccessible to all the followers in this paper. A data-based learning algorithm is first proposed to reconstruct the leader's unknown system matrix online. A distributed predictor subject to communication delays is further devised to estimate the leader's state, where interaction delays are allowed to be nonidentical. Then, a learning-based local controller, together with a discounted performance function, is projected to reach the optimal output synchronization. Bellman equations and game algebraic Riccati equations are constructed to learn the optimal solution by developing a model-based reinforcement learning (RL) algorithm online without solving regulator equations, which is followed by a model-free off-policy RL algorithm to relax the requirement of all agents' dynamics faced by the model-based RL algorithm. The optimal tracking control of HMASs subject to unknown leader dynamics and communication delays is shown to be solvable under the proposed RL algorithms. Finally, the effectiveness of theoretical analysis is verified by numerical simulations.

Heterogeneous formation control of multiple rotorcrafts with unknown dynamics by reinforcement learning

Distributed Leader-follower Formation Control of Nonholonomic Mobile Robots

Heterogeneous formation control of multiple UAVs with limited-input leader via reinforcement learning

Low-complexity Formation Control of Marine Vehicle System Based on Prescribed Performance

Distributed output formation tracking control of heterogeneous multi-agent systems using reinforcement learning

Reinforcement Learning-Based Unknown Reference Tracking Control of HMASs with Nonidentical Communication Delays

Data-Driven Optimal Formation Control for Quadrotor Team With Unknown Dynamics

Data-driven time-varying formation-containment control for a heterogeneous air-ground vehicle team subject to active leaders and switching topologies

Optimal robust formation control for heterogeneous multi‐agent systems based on reinforcement learning

Robust Formation Control for Cooperative Underactuated Quadrotors via Reinforcement Learning

Adaptive leader-follower formation control for autonomous mobile robots

Data-Driven Formation Control for Multiple Heterogeneous Vehicles in Air–Ground Coordination

Data-Driven Optimal Formation Control for Multiple Nonlinear Quadrotors With Switching Topologies

Distributed Optimal Formation Control for an Uncertain Multiagent System in the Plane

Distributed Formation Control of Multiple Quadrotor Aircraft Based on Nonsmooth Consensus Algorithms

Optimal consensus control for unknown second-order multi-agent systems: Using model-free reinforcement learning method

Distributed Cooperative Control of Heterogeneous Multiagent Systems for Air‐to‐Ground Formation

Decentralized Multi-Robot Formation Control Using Reinforcement Learning

Distributed Neuroadaptive Formation Control for Aerial Base Station-Assisted Hovercraft Systems with Mixed Disturbances

Adaptive Fixed-time Optimal Formation Control for Uncertain Nonlinear Multiagent Systems Using Reinforcement Learning

Flexible Formation Control Using Hausdorff Distance: A Multi-agent Reinforcement Learning Approach.