Abstract:Highlights • The augmented time-varying value function (TVRE) can be represented as the time-varying quadratic form is demonstrated. In conjunction with this finding, the time-varying Riccati equation for the finite-horizon optimal secure tracking control problem is derived. • The TVRE derived in this paper accounts for the probability of malicious DoS attacks. The impact of the DoS attacks on the solution of the TVRE is demonstrated. The convergence of the TVRE is proved under certain assumptions. Furthermore, a lower bound on the probability of DoS attacks that satisfies these assumptions is derived. • A time-varying Q-function (TVQF) that relies on the tracking control input is designed. The equivalence between the approximation of the TVQF kernel matrix and the solution of the derived TVRE is proved. Additionally, a backward-in-time, TVQF-based optimal secure tracking control algorithm that approximates the kernel matrix without the system dynamic is developed in the paper. The finite-horizon optimal secure tracking control (FHOSTC) problem for cyber–physical systems under actuator denial-of-service (DoS) attacks is addressed in this paper. A model-free method based on the Q-function is designed to achieve FHOSTC without the system model information. First, an augmented time-varying Riccati equation (TVRE) is derived by integrating the system with the reference system into a unified augmented system. Then, a lower bound on malicious DoS attacks probability that guarantees the solutions of the TVRE is provided. Third, a Q-function that changes over time (time-varying Q-function, TVQF) is devised. A TVQF-based method is then proposed to solve the TVRE without the need for the knowledge of the augmented system dynamics. The developed method works backward-in-time and uses the least-squares method. To validate the performance and features of the developed method, simulation studies are conducted in the end.

Reinforcement Learning-based Tracking Control for Networked Control Systems with DoS Attacks

Perceptual Interaction-Based Path Tracking Control of Autonomous Vehicles under DoS Attacks: A Reinforcement Learning Approach

Learning Tracking Control for Cyber–Physical Systems

Optimized Adaptive Fuzzy Security Control of Nonlinear Systems with Prescribed Tracking Performance

Optimal Resilient Tracking Control for Networked Systems With Multi-Channels Under Attacks

Adaptive Event-Based Tracking Control of Unmanned Marine Vehicle Systems with DoS Attack

Data-Based Collaborative Learning for Multiagent Systems under Distributed Denial-of-Service Attacks

Model-Based Event-Triggered Adaptive Tracking Control for Discrete-Time Nonlinear Systems under DoS Attacks

Event-triggered Active Disturbance Rejection Control for Nonlinear Network Control Systems Subject to DoS and Physical Attacks

Prescribed Performance Fuzzy Resilient Control for Nonlinear Systems under DoS Attacks

Resilient path-following control of autonomous vehicles subject to intermittent denial-of-service attacks

Neural-network-based Adaptive Secure Control for Nonstrict-Feedback Nonlinear Interconnected Systems under DoS Attacks

A Dynamic Controller Design for Trajectory Tracking Control of Wheeled Mobile Robot under Stochastic Denial of Service Attacks

Resilient Learning-Based Control Under Denial-of-Service Attacks

Robust Adaptive Control for a Class of Networked Nonlinear Systems under Denial-of-service Attacks

Finite-horizon optimal secure tracking control under denial-of-service attacks

Adaptive Control of Strict-Feedback Nonlinear Systems under Denial-of-Service: A Synthetic Analysis

Dynamic Event-Triggered H∞ Control for Networked Control Systems with Denial-of-Service Attacks

Event‐triggered tracking control for networked control systems under diversified attacks

A Jointly Optimal Design of Control and Scheduling in Networked Systems under Denial-of-Service Attacks

H∞ control for cyber physical systems under DoS attacks via tracking-removed autoencoder