Abstract:An autonomous and resilient controller is proposed for leader-follower multi-agent systems under uncertainties and cyber-physical attacks. The leader is assumed non-autonomous with a nonzero control input, which allows changing the team behavior or mission in response to environmental changes. A resilient learning-based control protocol is presented to find optimal solutions to the synchronization problem in the presence of attacks and system dynamic uncertainties. An observer-based distributed H_infinity controller is first designed to prevent propagating the effects of attacks on sensors and actuators throughout the network, as well as to attenuate the effect of these attacks on the compromised agent itself. Non-homogeneous game algebraic Riccati equations are derived to solve the H_infinity optimal synchronization problem and off-policy reinforcement learning is utilized to learn their solution without requiring any knowledge of the agent's dynamics. A trust-confidence based distributed control protocol is then proposed to mitigate attacks that hijack the entire node and attacks on communication links. A confidence value is defined for each agent based solely on its local evidence. The proposed resilient reinforcement learning algorithm employs the confidence value of each agent to indicate the trustworthiness of its own information and broadcast it to its neighbors to put weights on the data they receive from it during and after learning. If the confidence value of an agent is low, it employs a trust mechanism to identify compromised agents and remove the data it receives from them from the learning process. Simulation results are provided to show the effectiveness of the proposed approach.

Resilient Autonomous Control of Distributed Multi-agent Systems in Contested Environments

Data-Based Collaborative Learning for Multiagent Systems under Distributed Denial-of-Service Attacks

Off-Policy Learning-Based Following Control of Cooperative Autonomous Vehicles Under Distributed Attacks

Resilient neural network-based control of nonlinear heterogeneous multi-agent systems: a cyber-physical system approach

Data-Driven Resilient Control for Linear Discrete-Time Multi-Agent Networks under Unconfined Cyber-Attacks

Resilient dynamic output feedback control for leader-following consensus of high-order uncertain multi-agent systems under sensor-actuator attacks

Resilient Consensus Tracking Control for Uncertain Nonlinear Multi-agent Systems With DoS Attacks

Resilient coordination of multi-agent systems in the presence of unknown heterogeneous actuation efficiency and coupled dynamics: distributed approaches

Observer-Based Resilient Consensus Control for Heterogeneous Multiagent Systems Against Cyberattacks

Resilient Consensus for Discrete-Time Multiagent Systems With a Dynamic Leader and Time Delay: Theory and Experiment

Learning-Based Distributed Resilient Fault-Tolerant Control Method for Heterogeneous MASs Under Unknown Leader Dynamic

Robust Distributed Containment Control with Adaptive Performance and Collision Avoidance for Multi-Agent Systems

Distributed Adaptive Consensus with Obstacle and Collision Avoidance for Networks of Heterogeneous Multi-Agent Systems

Resilient Distributed Control in the Presence of Misbehaving Agents in Networked Control Systems.

A resilient control strategy for cyber-physical systems subject to denial of service attacks: A leader-follower set-theoretic approach

Distributed time-varying Nash equilibrium in resilient multi-objective formation control for cyber-physical systems

Leader‐following consensus of uncertain strict feedback multiagent systems subject to sensor and actuator attacks

Observer-based Hierarchical Control of Heterogeneous Multiagent Systems under Attacks and Disturbances

Distributed Adaptive Repetitive Consensus Control Framework for Uncertain Nonlinear Leader-Follower Multi-Agent Systems.

Distributed model reference adaptive containment control of heterogeneous uncertain multi-agent systems

Output Resilient Containment Control of Heterogeneous Systems with Active Leaders Using Reinforcement Learning under Attack Inputs.