Abstract:In this paper, we consider cyber-physical system (CPS) with multiple remote state estimation under denial-of-service (DoS) attack in infinite time-horizon. The sensors monitor the system and send their local state estimate to remote estimators by choosing the local channels in "State 0" or "State 1". The aim of sensors is to find policies for choosing local channel in a specific state to transmit message to minimize the total estimation error covariance on account of energy-saving in an infinite time-horizon. The DoS attacker aims to achieve the opposite goal by choosing channels to attack or not. The games between sensors and DoS attacker under two different structures of public information are investigated, that is the open-loop case (where sensors and attacker cannot observe others' behaviors) and the closed-loop case (where sensors and attacker can observe the others' behaviors causally). For the open-loop case with assumption that the DoS attacker can get the information from the remote estimators to the sensors, the distributed reinforcement learning algorithms for sensors and attacker based on local information are proposed to find their Nash equilibrium policies, respectively. Further, we consider in closed loop case that the DoS attacker cannot get the information from the remote estimators to the sensors which leads to asymmetric information between the sensors and attacker. To derive Nash equilibrium policies for sensors and attacker, we convert the original game into a belief-based continuous-state stochastic game. The convergence of distributed reinforcement learning method is proved. Some simulations are presented to demonstrate its effectiveness.

Security Estimation under Denial-of-Service Attack with Energy Constraint.

A Game-Theoretic Method for Cross-Layer Stochastic Resilient Control Design in CPS.

Security State Estimation for Cyber-Physical Systems Against DoS Attacks Via Reinforcement Learning and Game Theory

Jamming Attacks on Remote State Estimation in Cyber-Physical Systems: A Game-Theoretic Approach.

Resilient State Estimation of Cyber-Physical System with Multichannel Transmission under DoS Attack

Risk Assessment and Defense Resource Allocation of Cyber-Physical Distribution Systems under Denial-of-Service Attacks

Transmission Scheduling for Remote State Estimation in CPSs with Two-Hop Networks Subject to DoS Attacks

Remote State Estimation Under DoS Attacks in CPSs With Arbitrary Tree Topology: A Bayesian Stackelberg Game Approach

Game-theoretical Model for Dynamic Defense Resource Allocation in Cyber-physical Power Systems Under Distributed Denial of Service Attacks

A Hierarchical Game Approach to the Coupled Resilient Control of CPS against Denial-of-Service Attack

Cyber-Attacks on Remote State Estimation in Industrial Control System: A Game-Based Framework

Optimal Denial-of-Service Attack Scheduling with Energy Constraint

Game Theoretical Dynamic Cybersecurity Defense Strategy for Electrical Cyber Physical Systems

Game-Theoretic Model for Optimal Cyber-Attack Defensive Decision-Making in Cyber-Physical Power Systems

Optimal Denial-of-Service Attack Scheduling in Cyber-Physical Systems ∗

Denial-of-service Attacks on Cyber-physical Systems Against Linear Quadratic Control: A Stackelberg-game Analysis

Optimal DoS Attack Strategy for Cyber-Physical Systems via Energy Allocation

Optimal Denial-of-Service Attack Strategy on State Estimation Over Infinite-Time Horizon

Energy-efficient DoS attack against remote state estimation

Distributed Reinforcement Learning for Cyber-Physical System with Multiple Remote State Estimation under DoS Attacker

Security Investment in Cyber-Physical Systems: Stochastic Games With Asymmetric Information and Resource Constrained Players