Abstract:The increasing autonomy and connectivity in cyber-physical systems (CPS) come with new security vulnerabilities that are easily exploitable by malicious attackers to spoof a system to perform dangerous actions. While the vast majority of existing works focus on attack prevention and detection, the key question is "what to do after detecting an attack?". This problem attracts fairly rare attention though its significance is emphasized by the need to mitigate or even eliminate attack impacts on a system. In this article, we study this attack response problem and propose novel real-time recovery for securing CPS. First, this work's core component is a recovery control calculator using a Linear-Quadratic Regulator (LQR) with timing and safety constraints. This component can smoothly steer back a physical system under control to a target state set before a safe deadline and maintain the system state in the set once it is driven to it. We further propose an Alternating Direction Method of Multipliers (ADMM) based algorithm that can fast solve the LQR-based recovery problem. Second, supporting components for the attack recovery computation include a checkpointer, a state reconstructor, and a deadline estimator. To realize these components respectively, we propose (i) a sliding-windowbased checkpointing protocol that governs sufficient trustworthy data, (ii) a state reconstruction approach that uses the checkpointed data to estimate the current system state, and (iii) a reachability-based approach to conservatively estimate a safe deadline. Finally, we implement our approach and demonstrate its effectiveness in dealing with totally 15 experimental scenarios which are designed based on 5 CPS simulators and 3 types of sensor attacks.

Reinforcement Learning Solution for Cyber-Physical Systems Security Against Replay Attacks

Replay Attack Detection for Cyber-Physical Systems with Sensitive States

A Game-Theoretic Method for Cross-Layer Stochastic Resilient Control Design in CPS.

Secure State Estimation of Cyber-Physical System under Cyber Attacks: Q-Learning vs. SARSA

Finding Effective Security Strategies through Reinforcement Learning and Self-Play

A Dynamic Encryption–decryption Scheme for Replay Attack Detection in Cyber–physical Systems

Replay Attack Detection Based on Parity Space Method for Cyber-Physical Systems

Distributed Secure State Estimation for Cyber-Physical Systems Against Replay Attacks via Multisensor Method

Security Analysis of Cyber-Physical Systems Using Reinforcement Learning

A Secure Learning Control Strategy via Dynamic Camouflaging for Unknown Dynamical Systems under Attacks

An Ensemble Learning-Based Cyber-Attacks Detection Method of Cyber-Physical Power Systems

Real-time Cyber-Physical Security Solution Leveraging an Integrated Learning-Based Approach

Jamming Attack Against Remote State Estimation over Multiple Wireless Channels: A Reinforcement Learning Based Game Theoretical Approach.

Secure Control Against Replay Attacks.

An RL-Based Adaptive Detection Strategy to Secure Cyber-Physical Systems

A Hybrid Game Theory and Reinforcement Learning Approach for Cyber-Physical Systems Security

Applying Reinforcement Learning for Enhanced Cybersecurity against Adversarial Simulation

Reinforcement learning-based autonomous attacker to uncover computer network vulnerabilities

Secure Control for Markov Jump Cyber-Physical Systems Subject to Malicious Attacks: A Resilient Hybrid Learning Scheme

Reinforcement Learning for Industrial Control Network Cyber Security Orchestration

Real-Time Attack-Recovery for Cyber-Physical Systems Using Linear Approximations