Abstract:In this article, a data-efficient off-policy reinforcement learning (RL) approach is proposed for distributed output tracking control of heterogeneous multiagent systems (HMASs) using approximate dynamic programming (ADP). Different from existing results that the kinematic model of the exosystem is addressable to partial or all agents, the dynamics of the exosystem are assumed to be completely unknown for all agents in this article. To solve this difficulty, an identifiable algorithm using the experience-replay method is designed for each agent to identify the system matrices of the novel reference model instead of the original exosystem. Then, an output-based distributed adaptive output observer is proposed to provide the estimations of the leader, and the proposed observer not only has a low dimension and less data transmission among agents but also is implemented in a fully distributed way. Besides, a data-efficient RL algorithm is given to design the optimal controller offline along with the system trajectories without solving output regulator equations. An ADP approach is developed to iteratively solve game algebraic Riccati equations (GAREs) using online information of state and input in an online way, which relaxes the requirement of knowing prior knowledge of agents' system matrices in an offline way. Finally, a numerical example is provided to verify the effectiveness of theoretical analysis.

Adaptive Tracking Control for Heterogeneous Multi-Agent Systems with Unknown Exosystem and Disturbances

Distributed Adaptive Tracking Control for Unknown Nonlinear Networked Systems

Distributed Event-Triggered Tracking Control of Heterogeneous Discrete-Time Multi-Agent Systems with Unknown Parameters

Data-Efficient Off-Policy Learning for Distributed Optimal Tracking Control of HMAS with Unidentified Exosystem Dynamics.

Consensus Tracking of Multiagent Systems with Time-Varying Reference State and Exogenous Disturbances

Adaptive Fault Tolerant Tracking Control of Heterogeneous Multi-agent Systems with Non-cooperative Target

Distributed Average Tracking for Linear Heterogeneous Multi-Agent Systems With External Disturbances

Distributed Tracking Control Of Multi-Agent Systems With Heterogeneous Uncertainties

Adaptive tracking control of leader-following linear multi-agent systems with external disturbances.

Fully Distributed Time-Varying Formation Tracking Control for Linear Multi-Agent Systems with Unknown External Disturbances

Model‐free adaptive formation control for unknown multiinput‐multioutput nonlinear heterogeneous discrete‐time multiagent systems with bounded disturbance

Cooperative Robust And Perfect Tracking Of Heterogeneous Linear Multi-Agent Systems

Neural-Network-Based Adaptive Tracking Control for Nonlinear Multiagent Systems: The Observer Case

Output feedback based adaptive consensus tracking for uncertain heterogeneous multi-agent systems with event-triggered communication

Distributed fixed-time leader-following consensus tracking control for nonholonomic multi-agent systems with dynamic uncertainties

Distributed Fixed-Time Consensus Tracking for High-Order Uncertain Non-Linear Multi-Agent Systems with Switching Topologies

Adaptive Tracking Control of Second-Order Multiagent Systems with Jointly Connected Topologies

Distributed Finite-Time Tracking Control For Nonlinear Multi-Agent Systems Subject To External Disturbances

Adaptive Expected-Time Tracking Consensus Control for Multiagent Systems with External Disturbances and Time Delays

Fully Distributed Tracking Control For Non-Identical Multi-Agent Systems With Matching Uncertainty

Data-Driven Distributed Predictive Tracking Control for Heterogeneous Nonlinear Multi-Agent Systems With Communication Delays