Finite-horizon optimal secure tracking control under denial-of-service attacks

Jian Wang,Wei Wang,Xiaofeng Liang
DOI: https://doi.org/10.1016/j.isatra.2024.04.025
IF: 7.3
2024-04-27
ISA Transactions
Abstract:Highlights • The augmented time-varying value function (TVRE) can be represented as the time-varying quadratic form is demonstrated. In conjunction with this finding, the time-varying Riccati equation for the finite-horizon optimal secure tracking control problem is derived. • The TVRE derived in this paper accounts for the probability of malicious DoS attacks. The impact of the DoS attacks on the solution of the TVRE is demonstrated. The convergence of the TVRE is proved under certain assumptions. Furthermore, a lower bound on the probability of DoS attacks that satisfies these assumptions is derived. • A time-varying Q-function (TVQF) that relies on the tracking control input is designed. The equivalence between the approximation of the TVQF kernel matrix and the solution of the derived TVRE is proved. Additionally, a backward-in-time, TVQF-based optimal secure tracking control algorithm that approximates the kernel matrix without the system dynamic is developed in the paper. The finite-horizon optimal secure tracking control (FHOSTC) problem for cyber–physical systems under actuator denial-of-service (DoS) attacks is addressed in this paper. A model-free method based on the Q-function is designed to achieve FHOSTC without the system model information. First, an augmented time-varying Riccati equation (TVRE) is derived by integrating the system with the reference system into a unified augmented system. Then, a lower bound on malicious DoS attacks probability that guarantees the solutions of the TVRE is provided. Third, a Q-function that changes over time (time-varying Q-function, TVQF) is devised. A TVQF-based method is then proposed to solve the TVRE without the need for the knowledge of the augmented system dynamics. The developed method works backward-in-time and uses the least-squares method. To validate the performance and features of the developed method, simulation studies are conducted in the end.
automation & control systems,instruments & instrumentation,engineering, multidisciplinary
What problem does this paper attempt to address?