Abstract:This paper employs a reinforcement learning (RL) technique to investigate the distributed output tracking control of heterogeneous multiagent systems (MASs) under multiple denial-of-service (DoS) attacks. Different from existing results where the dynamic of the leader is known for partial or all agents, the leader’s system matrix is completely unknown for each follower in this paper. To learn the leader system matrix, a data-based learning mechanism is first proposed using the idea of the data-driven method. Then, under the data-based learning mechanism, a resilient predictor subject to multiple DoS attacks is exploited to provide the estimation of the leader’s state for each agent, where adversaries attack different communication links independently. Moreover, a resilient dynamic output feedback controller is proposed to solve the output tracking control problem based on the output regulation theory. To consider the transient responses of agents, a RL-based dynamic output feedback controller is developed to realize the optimal output tracking control by solving discounted algebraic Riccati equations (AREs) in both offline and online ways. Theoretical analysis shows that the secure output tracking control of MASs can be achieved under the proposed data-based resilient learning control algorithm. Finally, a numerical example is provided to verify the effectiveness of theoretical analysis.

Data-driven cooperative output regulation of multi-agent systems under distributed denial of service attacks

Data-Based Collaborative Learning for Multiagent Systems under Distributed Denial-of-Service Attacks

Cooperative Output Regulation of Linear Multi-Agent Network Systems with Dynamic Edges.

A Game-Theoretic Method for Resilient Control Design in Industrial Multi-Agent CPSs with Markovian and Coupled Dynamics

Resilient Cooperative Output Regulation for Nonlinear Multiagent Systems Under DoS Attacks

Cooperative Output Synchronization of Networked Systems in Strict Feedback Form in the Presence of Unknown Disturbance

Resilient practical cooperative output regulation for MASs with unknown switching exosystem dynamics under DoS attacks

Data-Driven-Based Cooperative Resilient Learning Method for Nonlinear MASs under DoS Attacks.

Adaptive self-triggered control-based cooperative output regulation of heterogeneous multi-agent systems under sensor and actuator attack

Data-driven cooperative optimal output regulation for linear discrete-time multi-agent systems by online distributed adaptive internal model approach

Distributed Adaptive Consensus Control for Nonlinear Systems with Active-Defense Mechanism Against Denial-of-Service Attacks

New Results in Cooperative Adaptive Optimal Output Regulation

Distributed Model-Free Adaptive Control for Learning Nonlinear MASs under DoS Attacks

Data-Driven Cooperative Output Regulation of Continuous-Time Multi-Agent Systems with Unknown Network Topology

Event‐triggered Output Synchronization for Nonhomogeneous Agent Systems with Periodic Denial‐of‐service Attacks

Robust Cooperative Output Regulation of Uncertain Linear Multi-Agent Systems Not Detectable by Regulated Output

Distributed Algorithm for Constrained Social Cost Minimization Problem of Heterogeneous Linear Multi-Agent Systems Against DoS Attacks

Load Frequency Control of Networked Multi-Area Power Systems under DoS Attack and Actuator Failure

Resilient control under denial-of-service and uncertainty: An adaptive dynamic programming approach

Robust Cooperative Output Regulation of Heterogeneous Uncertain Linear Multiagent Systems with Time-Varying Communication Topologies

Data-Driven Cooperative Output Regulation of Linear Discrete-Time Multiagent Systems With Unknown Dynamics