Abstract:Highlights • The augmented time-varying value function (TVRE) can be represented as the time-varying quadratic form is demonstrated. In conjunction with this finding, the time-varying Riccati equation for the finite-horizon optimal secure tracking control problem is derived. • The TVRE derived in this paper accounts for the probability of malicious DoS attacks. The impact of the DoS attacks on the solution of the TVRE is demonstrated. The convergence of the TVRE is proved under certain assumptions. Furthermore, a lower bound on the probability of DoS attacks that satisfies these assumptions is derived. • A time-varying Q-function (TVQF) that relies on the tracking control input is designed. The equivalence between the approximation of the TVQF kernel matrix and the solution of the derived TVRE is proved. Additionally, a backward-in-time, TVQF-based optimal secure tracking control algorithm that approximates the kernel matrix without the system dynamic is developed in the paper. The finite-horizon optimal secure tracking control (FHOSTC) problem for cyber–physical systems under actuator denial-of-service (DoS) attacks is addressed in this paper. A model-free method based on the Q-function is designed to achieve FHOSTC without the system model information. First, an augmented time-varying Riccati equation (TVRE) is derived by integrating the system with the reference system into a unified augmented system. Then, a lower bound on malicious DoS attacks probability that guarantees the solutions of the TVRE is provided. Third, a Q-function that changes over time (time-varying Q-function, TVQF) is devised. A TVQF-based method is then proposed to solve the TVRE without the need for the knowledge of the augmented system dynamics. The developed method works backward-in-time and uses the least-squares method. To validate the performance and features of the developed method, simulation studies are conducted in the end.

Optimal Disturbance Rejection and Robustness for Infinite Dimensional LTV Systems

Approximate Controllability of Infinite Dimensional Linear Systems in Nonreflexive State Spaces

On Robustness in the Gap Metric and Coprime Factor Uncertainty for LTV Systems

Finite Horizon Robustness Analysis of LTV Systems Using Integral Quadratic Constraints

Invariant Approximations and Disturbance Attenuation for Constrained Linear Discrete-Time Systems

Unique non-negative definite solution of the time-varying algebraic Riccati equations with applications to stabilization of LTV systems

Robust adaptive state-feedback control of linear time-varying systems under both potentially unbounded system's modeling uncertainty and external disturbance

Online Stabilization of Unknown Linear Time-Varying Systems

Robust Stability Analysis of a Class of LTV Systems

A controller management scheme for active fault-tolerant tracking: Linear discrete-time systems

Finite-time Stabilization of Linear Systems by Bounded Linear Time-Varying Feedback

Moment LMI approach to LTV impulsive control

The Distributionally Robust Infinite-Horizon LQR

Infinite-Horizon Distributionally Robust Regret-Optimal Control

Adaptive Optimal Control for Linear Discrete Time-Varying Systems

Optimal control of linear stochastic systems with applications to time lag systems

Optimal Fault Detection for Linear Discrete Time-Varying Systems

A Linear Time-Varying Inequality Approach for Prescribed Time Stability and Stabilization

Optimal Control for Discrete-Time Systems under Bounded Disturbances

$$H_{2}$$-Optimization-based Fault Detection for LDTV Systems

Finite-horizon optimal secure tracking control under denial-of-service attacks