Abstract:In this article, a model-free optimal solution is proposed for the containment control problem of fully heterogeneous discrete-time multiagent systems, in which both leaders and followers have heterogeneous dynamics. In order to make followers converge to the convex combination of leaders predefined by the users using only the collected data, a distributed control framework based on reinforcement learning (RL) for completely heterogeneous multiagent systems is developed. On the basis of the difference between follower states and target states, a local discounted performance function without considering the input index is designed for each agent to obtain the local optimal controller. The advantage of the designed performance function is that the relationship between the gain matrix of the local optimal controller and the solution of the regulation equation can be established, thus avoiding the need to solve the output regulation equation explicitly. A model-free distributed adaptive observer is designed for each follower to replace the leaders’ states in optimal controller without the need to know the dynamics of leaders. Combining the optimal controller, model-free adaptive observer, and RL, the data-based optimal containment control algorithm for fully heterogeneous multiagent systems is designed and employed. Finally, numerical simulation results are given to verify the effectiveness of the proposed method.

Containment control for the cooperative output regulation of linear multi-agent systems

Containment Control of Multi-Agent Systems by Exploiting the Control Inputs of Neighbors

Output Containment Control for Heterogeneous Discrete-Time Linear Descriptor Multi-Agent Systems by a Feedforward Output Regulation Approach

Adaptive Fuzzy Containment Control for Uncertain Nonlinear Multiagent Systems

Designing Observer-Type Controller for Containment of Discrete-Time Linear MASs over Signed Graph

Output Containment Control of Linear Heterogeneous Multi-Agent Systems Using Internal Model Principle.

Cooperative Containment of Discrete‐time Linear Multi‐agent Systems

Distributed Adaptive Containment for Linear Multi-Agent Systems Using Output Information

Output Containment Control for Heterogeneous Linear Multiagent Systems with Fixed and Switching Topologies.

Containment Control of General Linear Multi-Agent Systems by Event-Triggered Control Mechanisms

Adaptive Output Containment Control of Heterogeneous Multi-Agent Systems with Unknown Leaders

Containment Control of a Class of Heterogeneous Nonlinear Multi-Agent Systems.

Containment Control for General Discrete Time Second-Order Multi-Agent Systems

Containment for Linear Multi-Agent Systems with Exogenous Disturbances

Containment Control for High-Order Multi-Agent Systems with Nonconvex Control Input Constraints and Non-Particle Leaders

Distributed Robust Containment Control of Linear Heterogeneous Multi-Agent Systems: an Output Regulation Approach.

Distributed adaptive containment control of heterogeneous linear multi-agent systems: an output regulation approach

An Output Containment Approach to Cooperative Control of Multiple Unmanned and Manned Vehicles

Model-Free Containment Control of Fully Heterogeneous Linear Multiagent Systems

Distributed Containment Control of Linear Multi-Agent Systems with Multiple Leaders of Bounded Unknown Inputs

Containment Control of Singular Heterogeneous Multi-Agent Systems