Abstract:This paper investigates the resilient distributed secure output path following control problem of heterogeneous autonomous ground vehicles (AGVs) subject to cyber attacks based on reinforcement learning algorithm. Most existing results are subject to the same attack models for all communication channels, however multiple channels launched by different attackers are considered in this paper. First, a predictor-acknowledgement clock algorithm for each vehicle is proposed to judge whether the communication channel among neighboring vehicles is attacked or not by receiving or transmitting an acknowledgement. Then, a resilient distributed predictor is proposed to predict the pinning vehicle's state for each vehicle. In addition, a resilient local control protocol consisting of the feedforward state provided by the predictor and the local feedback state of each vehicle is developed for the output path following problem, which is further converted to the optimal control problem by designing a discounted performance function. Discounted algebraic Riccati equations (AREs) are derived to address the optimal control problem. An off-policy reinforcement learning (RL) algorithm is put forward to learn the solution of discounted AREs online without any prior knowledge of vehicles' dynamics. It is shown that the RL-based output path following control problem of AGVs imposed by cyber attacks can be achieved in an optimal manner. Finally, a numerical example is provided to verify the effectiveness of theoretical analysis.

NARX Model-Based Data-Driven Secure Control for UMVs under Asynchronous DoS Attacks

Adaptive Event-Based Tracking Control of Unmanned Marine Vehicle Systems with DoS Attack

A Model Predictive Control Approach for USV Autonomous Cruising Via Disturbance Learning

Data-Driven-Based Cooperative Resilient Learning Method for Nonlinear MASs under DoS Attacks.

A Semi-Markovian Jumping System Approach to Secure DPC of Nonlinear Networked Unmanned Marine Vehicle Systems with DoS Attack

Finite-time Security Control of Networked Unmanned Marine Vehicle Systems Subject to DoS Attack

Finite-time resilient sliding mode control of nonlinear UMV systems subject to DoS attacks

Intelligent Finite-Time Protocol-Based Stabilization for Networked UMV Systems with DoS Attacks

A3C-Based Intelligent Event-Triggering Control of Networked Nonlinear Unmanned Marine Vehicles Subject to Hybrid Attacks

Lyapunov matrix-based adaptive resilient control for unmanned marine vehicles with sensor and thruster attacks

Data‐driven adaptive trajectory tracking control of unmanned marine vehicles under disturbances and DoS attacks

T–S Fuzzy-Based Security Control of Nonlinear Unmanned Marine Vehicle Systems with Uncertain Stochastic DoS Attack

Intelligent Event-Based Fuzzy Dynamic Positioning Control of Nonlinear Unmanned Marine Vehicles Under DoS Attack

Adaptive Event-Based Dynamic Output Feedback Control for Unmanned Marine Vehicle Systems under Denial-of-Service Attack

Perceptual Interaction-Based Path Tracking Control of Autonomous Vehicles under DoS Attacks: A Reinforcement Learning Approach

Distributed Model-Free Adaptive Control for Learning Nonlinear MASs under DoS Attacks

Resilient sliding mode control of multiple autonomous underwater vehicles under stochastic DoS attack

Off-Policy Learning-Based Following Control of Cooperative Autonomous Vehicles Under Distributed Attacks

Event-Triggering and Quantized Sliding Mode Control of UMV Systems Under DoS Attack

Neural-Network-Based Adaptive Fault-Tolerant Cooperative Control of Heterogeneous Multiagent Systems With Multiple Faults and DoS Attacks

Resilient Model Predictive Control of Cyber–Physical Systems Under DoS Attacks